00000001:02000400:2.0F:1789131057.904758:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789131076.480513:0:3182:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789131078.150396:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 471 MB/s 00000001:01000000:2.0:1789131078.400595:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 715 MB/s 00000001:01000000:2.0:1789131078.650569:0:3245:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4659 MB/s 00000020:02000000:1.0F:1789131079.231009:0:3274:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_132_gd76390e 00000400:02000000:1.0:1789131079.854376:0:3289:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.152@tcp [8/256/0/180] 00008000:02000000:0.0:1789131083.685357:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789131130.494621:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789131138.575728:0:5826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789131138.575733:0:5826:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1789131138.575856:0:5826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000007b5a6322 00000080:02000400:0.0:1789131138.575865:0:5826:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789131138.580673:0:5826:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789131138.580688:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789131138.580727:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000cc0a5fa1) 00000020:00000080:0.0:1789131138.580760:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789131138.595105:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789131138.595521:0:5826:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789131138.617852:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789131138.617888:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789131138.617905:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789131138.617949:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789131138.617973:0:5826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789131138.618390:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789131138.618398:0:5826:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131138.618407:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790414d 00000020:01000004:2.0:1789131138.618414:0:5826:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789131138.618419:0:5826:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789131138.618423:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007b5a6322 from MGS 00000020:01000004:2.0:1789131138.618427:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789131138.618449:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000008933f04d) 00000020:00000080:2.0:1789131138.618462:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789131138.618607:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007b5a6322 from MGS, refs=2 00080000:01000000:2.0:1789131138.618614:0:5826:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789131138.618620:0:5826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790415b 00000100:00100000:2.0:1789131138.618709:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789131138.618851:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789131138.618857:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789131138.619465:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789131138.619473:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789131138.620182:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131138.620430:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789131138.620435:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789131138.620950:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789131138.620955:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789131138.621265:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789131138.621272:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789131138.622089:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131138.622092:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131138.622094:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131138.622476:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131138.622479:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131138.622480:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131138.623266:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789131138.628669:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789131138.872377:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3687 MB/s 00000001:01000000:3.0F:1789131139.122379:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4831 MB/s 00000001:01000000:3.0:1789131139.374201:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 772 MB/s 00000001:01000000:3.0:1789131139.623753:0:5826:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 719 MB/s 00080000:10000000:3.0:1789131139.634226:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789131139.649376:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789131139.649404:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789131139.649407:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789131139.650705:0:5836:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789131139.650768:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789131139.650810:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789131139.650992:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789131139.651018:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789131139.651690:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131139.651860:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789131139.651866:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789131139.652753:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789131139.652762:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789131139.653062:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789131139.653068:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789131139.653878:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789131139.653898:0:5826:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:2.0:1789131139.653900:0:5826:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789131139.653985:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:2.0:1789131139.653996:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (00000000920af420) 00000020:00000080:2.0:1789131139.654011:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789131139.654101:0:5826:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c36c81d7@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1789131139.654266:0:5826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:2.0:1789131139.654271:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789131139.654752:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789131139.657642:0:5842:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789131139.657983:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 42008966-81eb-4eb4-8558-cee0fff8e6d5) 00000020:00000080:2.0:1789131139.658005:0:5826:0:(genops.c:1385:class_connect()) connect: client 42008966-81eb-4eb4-8558-cee0fff8e6d5, cookie 0x9f0de37187904169 00000100:00080000:2.0:1789131139.658016:0:5826:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131139.658021:0:5826:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import 00000000c36c81d7 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1789131139.658050:0:5826:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006c92677b x1876039910293632/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131139.658119:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c92677b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42008966-81eb-4eb4-8558-cee0fff8e6d5:3305:1876039910293632:0@lo:250: 00000100:00100000:2.0:1789131139.658218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131139.660034:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910293632 00000100:00100000:2.0:1789131139.660046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910293632 00000100:00100000:2.0:1789131139.660084:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131139.660091:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000776dde65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3305:x1876039910293632:12345-0@lo:250: 00010000:00080000:2.0:1789131139.660115:0:5838:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 42008966-81eb-4eb4-8558-cee0fff8e6d5@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:2.0:1789131139.660140:0:5838:0:(genops.c:1385:class_connect()) connect: client 42008966-81eb-4eb4-8558-cee0fff8e6d5, cookie 0x9f0de37187904170 00000100:00080000:3.0:1789131139.660403:0:5826:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS 00000020:01000004:3.0:1789131139.660422:0:5826:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789131139.660442:0:5826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789131139.660462:0:5826:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a285c621) 00000020:00000080:3.0:1789131139.660487:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:2.0:1789131139.661159:0:5838:0:(import.c:65:import_set_state_nolock()) 000000008cdde8cd : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131139.661817:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000776dde65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:3305:x1876039910293632:12345-0@lo:250: Request processed in 1724us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131139.661829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131139.661913:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789131139.661921:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1789131139.661927:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789131139.661932:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789131139.661935:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000c36c81d7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789131139.661937:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789131139.661948:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789131139.661953:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c92677b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42008966-81eb-4eb4-8558-cee0fff8e6d5:3305:1876039910293632:0@lo:250: 00000100:00100000:3.0:1789131139.668295:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131139.668525:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789131139.668531:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789131139.672481:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789131139.672493:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789131139.672819:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789131139.672825:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789131139.673802:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131139.673970:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789131139.673976:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00010000:00010000:2.0:1789131139.674639:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131139.674692:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789131139.674698:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789131139.704165:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131139.704436:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789131139.704442:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789131139.706141:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789131139.706150:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789131139.706917:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131139.707062:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789131139.707066:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789131139.707621:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789131139.707627:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789131139.708220:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131139.708455:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789131139.708460:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789131139.709277:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789131139.709286:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789131139.710063:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131139.710217:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789131139.710222:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789131139.710983:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789131139.710992:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789131139.729968:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131139.730173:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789131139.730178:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789131139.732409:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789131139.732425:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789131139.733980:0:5826:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789131139.733993:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789131139.736070:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789131139.736096:0:5826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789131139.736103:0:5826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789131139.736224:0:5826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789131139.736255:0:5826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1789131139.736264:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789131139.736266:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131139.736267:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131139.736268:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131139.736269:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131139.736270:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131139.736271:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131139.736272:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131139.736273:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789131139.736275:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789131139.736276:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131139.736277:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131139.736279:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1789131139.736281:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131139.736283:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131139.736283:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131139.736284:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131139.736285:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131139.736286:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131139.736287:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131139.736288:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131139.736289:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789131139.736290:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789131139.736290:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131139.736291:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131139.736356:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789131139.736373:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002793bd9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910293760:0@lo:253: 00000100:00100000:1.0:1789131139.736450:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131139.736507:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c6388dd8 going to sleep for 11 seconds 00000100:00100000:3.0:1789131139.736680:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910293760 00000100:00100000:3.0:1789131139.736687:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910293760 00000100:00100000:3.0:1789131139.736737:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131139.736746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e91a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:5826:x1876039910293760:12345-0@lo:253: 20000000:01000000:3.0:1789131139.736789:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789131139.736792:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789131139.737805:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789131139.737895:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789131139.738113:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131139.739072:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1789131139.739358:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789131139.739363:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1789131139.739368:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1789131139.739371:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1789131139.739386:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1789131139.739572:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131139.739812:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1789131139.739825:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789131139.739879:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1789131139.739930:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1789131139.739970:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1789131139.740068:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1789131139.740077:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1789131139.740122:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1789131139.740130:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1789131139.740162:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1789131139.740169:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1789131139.740197:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1789131139.740248:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1789131139.740277:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789131139.740282:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1789131139.740295:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131139.740548:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1789131139.740559:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789131139.740594:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1789131139.740629:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1789131139.740677:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1789131139.740689:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1789131139.740776:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1789131139.740784:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789131139.740825:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1789131139.740860:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1789131139.740890:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1789131139.740900:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1789131139.740978:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1789131139.740986:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1789131139.741018:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1789131139.741054:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1789131139.741197:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1789131139.741243:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1789131139.741256:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789131139.742517:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789131139.742833:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789131139.742856:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:3.0:1789131139.742859:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789131139.742902:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789131139.742911:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789131139.742942:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789131139.742949:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1789131139.742993:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789131139.743003:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789131139.743035:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789131139.743070:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789131139.743129:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789131139.743132:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789131139.743137:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789131139.743143:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789131139.743498:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1789131139.743594:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789131139.753992:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789131139.754047:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1789131139.754123:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1789131139.754142:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789131139.754144:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789131139.754147:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789131139.754159:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789131139.754161:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789131139.754189:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789131139.754192:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789131139.756156:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1789131139.756722:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1789131139.756778:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1789131139.756872:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:3.0:1789131139.756883:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789131139.756886:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789131139.757224:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789131139.757750:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789131139.757798:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789131139.757831:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789131139.757841:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131139.757842:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789131139.757848:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789131139.757864:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757880:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757889:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757895:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757901:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757906:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757912:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fee3af44 already unused, calling callback (00000000eb703e4f) 00010000:00010000:1.0:1789131139.757915:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757921:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757941:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757948:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131139.757953:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fee3af44/0x9f0de3718790417e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789131139.757968:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789131139.951094:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e91a7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:5826:x1876039910293760:12345-0@lo:253: Request processed in 214341us (214637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131139.951110:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131139.951215:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002793bd9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910293760:0@lo:253: 10000000:01000000:0.0:1789131139.951230:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789131139.951233:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789131139.951235:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789131139.951236:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131139.951237:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789131139.951238:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131139.951239:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131139.951240:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789131139.951242:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789131139.951256:0:5826:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789131139.951258:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131139.951259:0:5826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789131139.951276:0:5826:0:(tgt_mount.c:101:server_register_mount()) register mount 000000007b5a6322 from lustre-MDT0000 10000000:01000000:0.0:1789131139.951301:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789131139.951304:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789131139.951309:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c0c492c0000 10000000:01000000:0.0:1789131139.951313:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131139.951347:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c0c492c0000 from 1 10000000:01000000:0.0:1789131139.951350:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789131139.951387:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.951397:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.951405:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131139.951421:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910293888:0@lo:101: 00000100:00100000:0.0:1789131139.951483:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.951527:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:2.0:1789131139.951744:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910293888 00000100:00100000:2.0:1789131139.951750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910293888 00000100:00100000:2.0:1789131139.951832:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131139.951840:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094b4e5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:5826:x1876039910293888:12345-0@lo:101: 00010000:00010000:2.0:1789131139.951852:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131139.951865:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904185 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131139.951885:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904185 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131139.951895:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904185 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131139.951903:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a72e1f6, rc 0) 00000100:00100000:2.0:1789131139.951942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094b4e5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+6:5826:x1876039910293888:12345-0@lo:101: Request processed in 104us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131139.951949:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131139.952010:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910293888:0@lo:101: 00010000:00010000:0.0:1789131139.952022:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.952029:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131139.952076:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294016:0@lo:501: 00000100:00100000:0.0:1789131139.952100:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.952232:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:3.0:1789131139.952304:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294016 00000100:00100000:3.0:1789131139.952315:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294016 00000100:00100000:3.0:1789131139.952363:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131139.952368:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b926d684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+6:5826:x1876039910294016:12345-0@lo:501: 00000100:00100000:3.0:1789131139.952746:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b926d684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+6:5826:x1876039910294016:12345-0@lo:501: Request processed in 377us (644us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131139.952754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131139.952834:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294016:0@lo:501: 10000000:01000000:0.0:1789131139.952860:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789131139.952882:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.952890:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131139.952897:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0c43124000 10000000:01000000:0.0:1789131139.952901:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789131139.952905:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c0c43124000 10000000:01000000:0.0:1789131139.952907:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789131139.952909:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c0c43124000 from 1 10000000:01000000:0.0:1789131139.952912:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789131139.952928:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.952934:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.952942:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131139.952954:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294144:0@lo:101: 00000100:00100000:0.0:1789131139.952980:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.953005:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:0.0:1789131139.953023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294144 00000100:00100000:0.0:1789131139.953027:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294144 00000100:00100000:0.0:1789131139.953045:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131139.953057:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070beb016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+6:5826:x1876039910294144:12345-0@lo:101: 00010000:00010000:0.0:1789131139.953065:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131139.953075:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005e86f914/0x9f0de3718790419a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904193 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953089:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e86f914/0x9f0de3718790419a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904193 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953097:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005e86f914/0x9f0de3718790419a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904193 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953103:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005e86f914, rc 0) 00000100:00100000:0.0:1789131139.953130:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070beb016 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+7:5826:x1876039910294144:12345-0@lo:101: Request processed in 74us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131139.953136:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131139.953169:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294144:0@lo:101: 00010000:00010000:0.0:1789131139.953178:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953185:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131139.953195:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789131139.953198:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953203:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000087d9c02/0x9f0de37187904193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131139.953219:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789131139.953222:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131139.953226:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c0c43124000 10000000:01000000:0.0:1789131139.953228:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789131139.953231:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789131139.953233:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789131139.953246:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953253:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953259:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131139.953269:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294272:0@lo:101: 00000100:00100000:0.0:1789131139.953292:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.953304:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:0.0:1789131139.953316:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294272 00000100:00100000:0.0:1789131139.953340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294272 00000100:00100000:0.0:1789131139.953358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131139.953362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bace3314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+7:5826:x1876039910294272:12345-0@lo:101: 00010000:00010000:0.0:1789131139.953368:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131139.953374:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879041a1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953386:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879041a1 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953402:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879041a1 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953408:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000080ce7069, rc 0) 00000100:00100000:0.0:1789131139.953437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bace3314 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+8:5826:x1876039910294272:12345-0@lo:101: Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131139.953443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131139.953472:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294272:0@lo:101: 00010000:00010000:0.0:1789131139.953481:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131139.953488:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131139.953526:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294400:0@lo:501: 00000100:00100000:0.0:1789131139.953635:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.953653:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:0.0:1789131139.953665:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294400 00000100:00100000:0.0:1789131139.953668:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294400 00000100:00100000:0.0:1789131139.953685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131139.953690:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dd75688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+8:5826:x1876039910294400:12345-0@lo:501: 00000100:00100000:0.0:1789131139.953890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dd75688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5826:x1876039910294400:12345-0@lo:501: Request processed in 199us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131139.953897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131139.953929:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294400:0@lo:501: 00000100:00100000:0.0:1789131139.953953:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294528:0@lo:503: 00000100:00100000:0.0:1789131139.953999:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131139.954011:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e67f3161 going to sleep for 11 seconds 00000100:00100000:0.0:1789131139.954024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294528 00000100:00100000:0.0:1789131139.954028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294528 00000100:00100000:0.0:1789131139.954047:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789131139.954052:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000422cf698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5826:x1876039910294528:12345-0@lo:503: 00000100:00100000:0.0:1789131139.954193:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000422cf698 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5826:x1876039910294528:12345-0@lo:503: Request processed in 140us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131139.954200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789131139.954237:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294528:0@lo:503: 00000100:00100000:2.0:1789131139.954815:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c92677b pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5867:1876039910294656:0@lo:502: 00000100:00100000:2.0:1789131139.954851:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131139.954879:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 0000000037ab4c76 going to sleep for 11 seconds 00000100:00100000:0.0:1789131139.954925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294656 00000100:00100000:0.0:1789131139.954930:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294656 00000100:00100000:0.0:1789131139.954960:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131139.954966:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8b4f946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5867:x1876039910294656:12345-0@lo:502: 00000100:00100000:0.0:1789131139.955114:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8b4f946 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5867:x1876039910294656:12345-0@lo:502: Request processed in 148us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131139.955121:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131139.955203:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c92677b pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5867:1876039910294656:0@lo:502: 00000020:01000000:3.0:1789131139.955226:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131139.955236:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131139.955238:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789131139.955243:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789131139.955246:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131139.955258:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000faf3926b) 00000020:00000080:3.0:1789131139.955273:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789131139.955278:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789131139.955348:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789131139.955353:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de371879041b6 00000020:00000080:3.0:1789131139.955523:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789131139.955527:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131139.955539:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131139.955540:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789131139.955542:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131139.955545:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131139.955546:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789131139.955547:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131139.955632:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000006c33acc0) 00000020:00000080:3.0:1789131139.955640:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789131139.955643:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789131139.955644:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789131139.955646:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789131139.955650:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789131139.955683:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007b5a6322 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789131139.955691:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000795577a2) 00000020:00000080:3.0:1789131139.955696:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789131139.955756:0:5867:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789131139.955769:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de371879041cb 00000020:00000080:3.0:1789131139.955862:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789131139.955868:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789131139.955873:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9f0de371879041d2 00080000:01000000:3.0:1789131139.955877:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789131139.955881:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de371879041d9 00080000:10000000:3.0:1789131139.956197:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789131139.956314:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789131139.959481:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789131140.049220:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789131140.049560:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789131140.054480:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789131140.054849:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789131140.084777:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008eac57da) 00000020:00000080:3.0:1789131140.084799:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789131140.084861:0:5867:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789131140.084868:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de371879041e7 00000020:00000080:2.0:1789131140.087243:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1789131140.088676:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789131140.131066:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131140.161101:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131140.187257:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789131140.226666:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789131140.275975:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1789131140.336721:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9f0de371879041ee 00000020:00000080:1.0:1789131140.337832:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789131140.337844:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131140.337851:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131140.337854:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789131140.337857:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131140.337862:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131140.337864:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789131140.337868:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789131140.337906:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789131140.337919:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131140.337923:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131140.337924:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789131140.337927:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131140.337929:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131140.337930:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789131140.337933:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131140.337934:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789131140.337975:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000643f5b07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5867:1876039910294784:0@lo:502: 00000100:00100000:1.0:1789131140.338131:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131140.338190:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b538a053 going to sleep for 11 seconds 00000100:00100000:2.0:1789131140.339174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294784 00000100:00100000:2.0:1789131140.339183:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294784 00000100:00100000:2.0:1789131140.339302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131140.339312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011ec8cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5867:x1876039910294784:12345-0@lo:502: 00000100:00100000:2.0:1789131140.340093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011ec8cd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5867:x1876039910294784:12345-0@lo:502: Request processed in 780us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.340109:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131140.340303:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000643f5b07 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5867:1876039910294784:0@lo:502: 00000020:01000000:1.0:1789131140.340690:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131140.340699:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131140.340702:0:5867:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789131140.340707:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789131140.340893:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789131140.340914:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789131140.340977:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.340990:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131140.340998:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43124000 from 1 10000000:01000000:0.0:1789131140.341074:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131140.341107:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.341114:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.341122:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131140.341137:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294912:0@lo:101: 00000100:00100000:0.0:1789131140.341177:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131140.341263:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b68fb72 going to sleep for 11 seconds 00000100:00100000:2.0:1789131140.342819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910294912 00000100:00100000:2.0:1789131140.342830:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910294912 00000100:00100000:2.0:1789131140.342919:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131140.342928:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000203ba8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:5826:x1876039910294912:12345-0@lo:101: 00010000:00010000:2.0:1789131140.342943:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131140.342960:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879041f5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.342983:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879041f5 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.342992:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879041f5 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.343000:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005f91d050, rc 0) 00000100:00100000:2.0:1789131140.343132:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000203ba8b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:5826:x1876039910294912:12345-0@lo:101: Request processed in 206us (1955us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.343140:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131140.343230:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910294912:0@lo:101: 00010000:00010000:0.0:1789131140.343247:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.343255:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131140.343874:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295040:0@lo:256: 00000100:00100000:0.0:1789131140.343919:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131140.344432:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b68fb72 going to sleep for 11 seconds 00000100:00100000:1.0:1789131140.344775:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295040 00000100:00100000:1.0:1789131140.344783:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295040 00000100:00100000:3.0:1789131140.344825:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789131140.344837:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029b49a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:5826:x1876039910295040:12345-0@lo:256: 20000000:01000000:3.0:1789131140.344856:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789131140.344861:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789131140.345137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029b49a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:5826:x1876039910295040:12345-0@lo:256: Request processed in 304us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131140.345145:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131140.345293:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028df62b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295040:0@lo:256: 10000000:01000000:0.0:1789131140.346289:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131140.346414:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.346426:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131140.347997:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 1 10000000:01000000:1.0:1789131140.348070:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131140.348116:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.348125:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.348133:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131140.348153:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295168:0@lo:101: 00000100:00100000:1.0:1789131140.348217:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131140.348695:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c3fefb going to sleep for 11 seconds 00000100:00100000:2.0:1789131140.348833:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295168 00000100:00100000:2.0:1789131140.348841:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295168 00000100:00100000:2.0:1789131140.348896:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789131140.348904:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090770eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:5826:x1876039910295168:12345-0@lo:101: 00010000:00010000:2.0:1789131140.348917:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131140.348930:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904203 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.348952:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904203 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.348979:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904203 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.348987:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cbd05a74, rc 0) 00000100:00100000:2.0:1789131140.349048:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090770eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295168:12345-0@lo:101: Request processed in 145us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.349055:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131140.349190:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295168:0@lo:101: 00010000:00010000:1.0:1789131140.349205:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.349224:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131140.349283:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295296:0@lo:501: 00000100:00100000:1.0:1789131140.349316:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131140.349367:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c3fefb going to sleep for 11 seconds 00000100:00100000:3.0:1789131140.349495:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295296 00000100:00100000:3.0:1789131140.349501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295296 00000100:00100000:3.0:1789131140.349770:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131140.349778:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013cc7080 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295296:12345-0@lo:501: 00000100:00100000:3.0:1789131140.350829:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013cc7080 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295296:12345-0@lo:501: Request processed in 1049us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131140.350840:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131140.351078:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295296:0@lo:501: 00000100:00100000:1.0:1789131140.351123:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295424:0@lo:503: 00000100:00100000:1.0:1789131140.351165:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131140.351245:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089c3fefb going to sleep for 11 seconds 00000100:00100000:2.0:1789131140.352947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295424 00000100:00100000:2.0:1789131140.352959:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295424 00000100:00100000:1.0:1789131140.353170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131140.353179:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d671f015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295424:12345-0@lo:503: 00000040:00080000:1.0:1789131140.353252:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131140.353385:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d671f015 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295424:12345-0@lo:503: Request processed in 208us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131140.353393:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789131140.353493:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000019971ac8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295424:0@lo:503: 00000040:00080000:0.0:1789131140.356458:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789131140.357076:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789131140.357096:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131140.357110:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.357122:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131140.357173:0:5826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789131140.357176:0:5826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0c43124000 10000000:01000000:2.0:1789131140.357478:0:5826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0c43124000 10000000:01000000:2.0:1789131140.357711:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131140.357717:0:5826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43124000 from 1 10000000:01000000:2.0:1789131140.357719:0:5826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789131140.357764:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.357773:0:5826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.357800:0:5826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131140.357821:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295552:0@lo:101: 00000100:00100000:2.0:1789131140.358001:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.358061:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa168393 going to sleep for 11 seconds 00000100:00100000:1.0:1789131140.358121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295552 00000100:00100000:1.0:1789131140.358128:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295552 00000100:00100000:1.0:1789131140.358173:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131140.358181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094ac1d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910295552:12345-0@lo:101: 00010000:00010000:1.0:1789131140.358193:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131140.358205:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904211 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.358226:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904211 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.358235:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904211 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131140.358243:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002499f6ed, rc 0) 00000100:00100000:1.0:1789131140.358776:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094ac1d37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910295552:12345-0@lo:101: Request processed in 595us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131140.358784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131140.358903:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295552:0@lo:101: 00010000:00010000:2.0:1789131140.358918:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.358925:0:5826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131140.358977:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295680:0@lo:501: 00000100:00100000:2.0:1789131140.359005:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.359062:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa168393 going to sleep for 11 seconds 00000100:00100000:1.0:1789131140.359100:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295680 00000100:00100000:1.0:1789131140.359104:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295680 00000100:00100000:1.0:1789131140.359165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131140.359173:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043f71e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910295680:12345-0@lo:501: 00000100:00100000:1.0:1789131140.359452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043f71e2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910295680:12345-0@lo:501: Request processed in 280us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131140.359460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131140.359670:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295680:0@lo:501: 00000100:00100000:2.0:1789131140.359702:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295808:0@lo:503: 00000100:00100000:2.0:1789131140.359748:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.360112:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fa168393 going to sleep for 11 seconds 00000100:00100000:3.0:1789131140.360182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295808 00000100:00100000:3.0:1789131140.360188:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295808 00000100:00100000:3.0:1789131140.360214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789131140.360221:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be5a9fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910295808:12345-0@lo:503: 00000100:00100000:3.0:1789131140.360952:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be5a9fe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910295808:12345-0@lo:503: Request processed in 729us (1201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131140.360961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131140.361180:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910295808:0@lo:503: 00000100:00100000:3.0:1789131140.364032:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f260510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5872:1876039910295936:0@lo:502: 00000100:00100000:3.0:1789131140.364113:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131140.364159:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 000000008263ffea going to sleep for 11 seconds 00000100:00100000:2.0:1789131140.364225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910295936 00000100:00100000:2.0:1789131140.364232:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910295936 00000100:00100000:2.0:1789131140.364288:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131140.364296:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed648371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5872:x1876039910295936:12345-0@lo:502: 00000100:00100000:2.0:1789131140.364803:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed648371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5872:x1876039910295936:12345-0@lo:502: Request processed in 508us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.364811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789131140.364921:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f260510 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5872:1876039910295936:0@lo:502: 00000020:01000004:3.0:1789131140.364983:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789131140.364997:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000dc649f58) 00000020:00000080:3.0:1789131140.365013:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789131140.365105:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 000000007b5a6322 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789131140.365109:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 000000007b5a6322 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789131140.365112:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 000000007b5a6322 4 00010000:00080000:3.0:1789131140.365138:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000750b006b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1789131140.368632:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789131140.368937:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789131140.368982:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789131140.368994:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9f0de37187904226 00000100:00080000:3.0:1789131140.369004:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789131140.369009:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000750b006b using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131140.369040:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000f260510 x1876039910296064/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131140.369073:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789131140.369354:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000f260510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910296064:0@lo:38: 00000100:00100000:0.0:1789131140.369421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131140.369807:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296064 00000100:00100000:3.0:1789131140.369813:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296064 00000100:00100000:3.0:1789131140.369849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131140.369854:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028df62b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910296064:12345-0@lo:38: 00000100:00100000:3.0:1789131140.369913:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028df62b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910296064:12345-0@lo:38: Request processed in 58us (492us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789131140.369920:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131140.369994:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000210add45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5872:1876039910296192:0@lo:502: 00000100:00100000:3.0:1789131140.370037:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131140.370060:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296192 00000100:00100000:3.0:1789131140.370064:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296192 00000100:00100000:3.0:1789131140.370091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789131140.370097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3a73ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5872:x1876039910296192:12345-0@lo:502: 00000100:00100000:3.0:1789131140.370295:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3a73ea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5872:x1876039910296192:12345-0@lo:502: Request processed in 198us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131140.370302:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789131140.370354:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003168369 going to sleep for 11 seconds 00000100:00100000:3.0:1789131140.370371:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000210add45 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:5872:1876039910296192:0@lo:502: 00000040:00080000:3.0:1789131140.370393:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1789131140.370581:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131140.370587:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000750b006b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131140.370591:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789131140.370594:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000f260510 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910296064:0@lo:38: 00000020:01000000:0.0:1789131140.370617:0:5826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789131140.370634:0:5826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789131140.370657:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.370668:0:5826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789131140.370710:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789131140.370712:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789131140.370713:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131140.370714:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131140.370715:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131140.370717:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131140.370718:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789131140.370719:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789131140.370720:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789131140.370721:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789131140.370732:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131140.370733:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789131140.370735:0:5826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789131140.370742:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789131140.370744:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789131140.370744:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131140.370745:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131140.370746:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131140.370747:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131140.370748:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789131140.370748:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789131140.370749:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789131140.370750:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789131140.370750:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131140.370751:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789131140.370766:0:5826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789131140.370774:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000023de610e pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910296320:0@lo:253: 00000100:00100000:0.0:1789131140.370816:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131140.370839:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000786ef67c going to sleep for 11 seconds 00000100:00100000:0.0:1789131140.373411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296320 00000100:00100000:0.0:1789131140.373423:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296320 00000100:00100000:0.0:1789131140.373489:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789131140.373497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000576f066e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5826:x1876039910296320:12345-0@lo:253: 20000000:01000000:0.0:1789131140.373527:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789131140.373540:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789131140.408967:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789131140.408985:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789131140.409100:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789131140.409119:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789131140.409141:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131140.409159:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879041f5 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131140.409167:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131140.409202:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131140.409216:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 12 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131140.409229:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000210add45 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910296448:0@lo:104: 00000100:00100000:3.0:1789131140.409289:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131140.409379:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000003168369 going to sleep for 11 seconds 00000100:00100000:0.0:1789131140.409502:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296448 00000100:00100000:0.0:1789131140.409510:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296448 00000100:00100000:0.0:1789131140.409667:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131140.409676:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c49bd9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910296448:12345-0@lo:104: 00010000:00010000:0.0:1789131140.409688:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131140.409757:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131140.409762:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c49bd9c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910296448:12345-0@lo:104: Request processed in 89us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131140.409778:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789131140.409894:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131140.409900:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.409907:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bd12274d already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:2.0:1789131140.409909:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.409916:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131140.409922:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131140.409927:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131140.409959:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.409965:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131140.409983:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.409988:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000bd12274d/0x9f0de371879041f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041fc expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410004:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131140.410005:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131140.410013:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131140.410065:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910296576:0@lo:103: 00000100:00100000:2.0:1789131140.410096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131140.410162:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296576 00000100:00100000:2.0:1789131140.410167:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296576 00010000:00010000:2.0:1789131140.410184:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 13 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131140.410207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131140.410213:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bdf43b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3307:x1876039910296576:12345-0@lo:103: 00010000:00010000:2.0:1789131140.410222:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131140.410226:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 13 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410235:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 13 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410250:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410256:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789131140.410269:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001151393s 00010000:00010000:2.0:1789131140.410273:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410279:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410285:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410296:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410302:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ab3f0098 already unused, calling callback (00000000eb703e4f) 00010000:00010000:2.0:1789131140.410305:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410312:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410355:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410366:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131140.410401:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bdf43b4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3307:x1876039910296576:12345-0@lo:103: Request processed in 188us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131140.410408:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131140.410444:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bd908ee3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910296576:0@lo:103: 00010000:00010000:2.0:1789131140.410491:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005f91d050/0x9f0de371879041fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879041f5 expref: 12 pid: 5838 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131140.410501:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000210add45 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910296448:0@lo:104: 00010000:00010000:2.0:1789131140.410512:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410519:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410524:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131140.410544:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ab3f0098/0x9f0de3718790422d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131140.439318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000576f066e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5826:x1876039910296320:12345-0@lo:253: Request processed in 65814us (68493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131140.439367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131140.439381:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000023de610e pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:5826:1876039910296320:0@lo:253: 10000000:01000000:2.0:1789131140.439399:0:5826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789131140.439404:0:5826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131140.439406:0:5826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789131140.439408:0:5826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131140.439409:0:5826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131140.439411:0:5826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131140.439412:0:5826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131140.439414:0:5826:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131140.439415:0:5826:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789131140.439417:0:5826:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789131140.439420:0:5826:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789131140.439421:0:5826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131140.439423:0:5826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789131140.439440:0:5826:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789131140.447176:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131140.447570:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131140.447799:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131140.447963:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131140.448162:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131140.448342:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131140.451847:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131140.452077:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131140.452289:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131140.452837:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131140.453095:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131140.453262:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789131140.514756:0:5826:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789131140.567458:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789131140.567982:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1789131140.571418:0:5877:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789131140.571424:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789131140.572057:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789131140.573132:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789131140.573615:0:5826:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789131140.573625:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789131140.573840:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131140.574820:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789131140.575384:0:5826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789131140.575414:0:5826:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789131140.575614:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789131140.575857:0:5826:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789131140.578026:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789131140.578192:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789131140.578375:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789131140.578507:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789131140.581391:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789131140.582113:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789131140.582273:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789131140.582450:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789131140.586398:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789131140.586654:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789131140.586804:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789131140.586944:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789131140.587067:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789131140.587192:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789131140.587355:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789131140.587509:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789131140.589123:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789131140.589274:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789131140.589460:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789131140.589912:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789131140.590083:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789131140.590218:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789131140.590408:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789131140.590683:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789131140.590831:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789131140.590952:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789131140.591077:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789131140.591208:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789131140.591379:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789131140.591496:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789131140.592249:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789131140.592972:0:5826:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789131140.593167:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789131140.614732:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789131140.691811:0:5826:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789131140.691849:0:5826:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba05c1deb988 00100000:10000000:2.0:1789131140.691856:0:5826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789131140.692829:0:5826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789131140.692844:0:5826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789131140.692859:0:5826:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789131140.692882:0:5826:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789131140.694889:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789131140.694955:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789131140.694960:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1789131140.697784:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131141.725576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131142.745489:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131143.771914:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131144.795126:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789131144.963931:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1789131145.689516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789131145.689527:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789131145.689529:0:8:0:(import.c:65:import_set_state_nolock()) 00000000750b006b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131145.689541:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000750b006b using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131145.689563:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d5d60aa x1876039910296832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131145.689669:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009d5d60aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910296832:0@lo:38: 00000100:00100000:2.0:1789131145.689751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131145.689833:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b836045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910296704:0@lo:400: 00000100:00100000:3.0:1789131145.689867:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131145.689941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296832 00000100:00100000:1.0:1789131145.689950:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296832 00000100:00100000:1.0:1789131145.689986:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131145.689992:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000524eef4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910296832:12345-0@lo:38: 00010000:00080000:1.0:1789131145.690015:0:5846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1789131145.690049:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9f0de37187904234 00000004:00100000:1.0:1789131145.690105:0:5846:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789131145.690228:0:5846:0:(import.c:65:import_set_state_nolock()) 0000000021c43a3e : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131145.690286:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000524eef4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876039910296832:12345-0@lo:38: Request processed in 293us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131145.690293:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789131145.690335:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009d5d60aa x1876039910296832/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789131145.690349:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789131145.690356:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789131145.690360:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789131145.690362:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000750b006b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789131145.690367:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009d5d60aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910296832:0@lo:38: 00000100:00100000:2.0:1789131145.690372:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296704 00000100:00100000:2.0:1789131145.690376:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296704 00000100:00100000:2.0:1789131145.690414:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131145.690421:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4b49b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3308:x1876039910296704:12345-0@lo:400: 00000100:00100000:2.0:1789131145.690461:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4b49b01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3308:x1876039910296704:12345-0@lo:400: Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131145.690473:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789131145.690523:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b836045 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910296704:0@lo:400: 00010000:00010000:0.0:1789131145.817434:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131146.845784:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789131147.225463:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131147.225472:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43124000 from 3 10000000:01000000:0.0:1789131147.225477:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131147.225875:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131147.225888:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131147.225900:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131147.225922:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b804b172 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910296960:0@lo:101: 00000100:00100000:0.0:1789131147.226210:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131147.226525:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d19398d going to sleep for 11 seconds 00000100:00100000:2.0:1789131147.231426:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910296960 00000100:00100000:2.0:1789131147.231441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910296960 00000100:00100000:3.0:1789131147.232165:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789131147.232181:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039168eca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5842:x1876039910296960:12345-0@lo:101: 00010000:00010000:3.0:1789131147.232200:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131147.232889:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007dc7eaa0/0x9f0de37187904242 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790423b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131147.232921:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007dc7eaa0/0x9f0de37187904242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131147.232931:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007dc7eaa0/0x9f0de37187904242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131147.232939:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007dc7eaa0, rc 0) 00000100:00100000:3.0:1789131147.233004:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039168eca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910296960:12345-0@lo:101: Request processed in 829us (6796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131147.233012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789131147.233142:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b804b172 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910296960:0@lo:101: 00010000:00010000:0.0:1789131147.233158:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131147.233167:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131147.233378:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b804b172 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910297088:0@lo:256: 00000100:00100000:0.0:1789131147.233418:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131147.233477:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d19398d going to sleep for 11 seconds 00000100:00100000:3.0:1789131147.236561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297088 00000100:00100000:3.0:1789131147.236575:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297088 00000100:00100000:3.0:1789131147.236648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789131147.236670:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008360911f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910297088:12345-0@lo:256: 20000000:01000000:3.0:1789131147.236709:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789131147.236723:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789131147.236727:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789131147.236974:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008360911f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910297088:12345-0@lo:256: Request processed in 305us (3555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131147.236983:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131147.237194:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b804b172 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910297088:0@lo:256: 10000000:01000000:1.0:1789131147.237260:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789131147.237268:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131147.237279:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000007c623590/0x9f0de3718790423b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131147.867391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131148.889720:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789131149.500093:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda7fc3eb0 20000000:00000080:1.0:1789131149.500112:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c42d73800 uarg=0000000000000000 20000000:01000000:1.0:1789131149.500154:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789131149.500161:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789131149.500172:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789131149.500523:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1789131149.500534:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789131149.509973:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131149.510212:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789131149.510278:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789131149.510362:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789131149.510381:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789131149.510399:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.510415:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904203 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.510422:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.510458:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.512308:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 11 pid: 5838 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131149.512342:0:6323:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876039910297216:0@lo:104: 00000100:00100000:0.0:1789131149.512428:0:6323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131149.512652:0:6323:0:(client.c:2715:ptlrpc_set_wait()) set 000000007d9bcfb2 going to sleep for 11 seconds 00000100:00100000:1.0:1789131149.515605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297216 00000100:00100000:1.0:1789131149.515619:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297216 00000100:00100000:1.0:1789131149.515750:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131149.515759:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000298090f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:6323:x1876039910297216:12345-0@lo:104: 00010000:00010000:1.0:1789131149.515777:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131149.516187:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131149.516194:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000298090f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:6323:x1876039910297216:12345-0@lo:104: Request processed in 436us (3765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131149.516202:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789131149.516239:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131149.516245:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516253:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fee3af44 already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:3.0:1789131149.516257:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516264:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131149.516269:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131149.516279:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789131149.516284:0:6323:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1876039910297216:0@lo:104: 00010000:00010000:2.0:1789131149.516306:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516312:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516317:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131149.516356:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516363:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000fee3af44/0x9f0de37187904203 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790420a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131149.516364:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd673aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910297344:0@lo:103: 00010000:00010000:3.0:1789131149.516395:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131149.516397:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131149.516399:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131149.516413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131149.516747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297344 00000100:00100000:3.0:1789131149.516752:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297344 00010000:00010000:3.0:1789131149.516773:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 12 pid: 5838 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131149.516806:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131149.516813:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c92677b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3309:x1876039910297344:12345-0@lo:103: 00010000:00010000:3.0:1789131149.516824:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131149.516828:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 12 pid: 5838 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516838:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 12 pid: 5838 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516864:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cbd05a74/0x9f0de3718790420a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904203 expref: 12 pid: 5838 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516877:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516885:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516899:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516906:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516918:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516924:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516929:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c326496d already unused, calling callback (00000000eb703e4f) 00010000:00010000:3.0:1789131149.516933:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516940:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516962:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131149.516972:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131149.517006:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c92677b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3309:x1876039910297344:12345-0@lo:103: Request processed in 194us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131149.517013:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131149.517038:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd673aa2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910297344:0@lo:103: 00010000:00010000:0.0:1789131149.517382:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.517391:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131149.517396:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c326496d/0x9f0de37187904249 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131149.913738:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131150.811178:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d3ac753d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910297472:0@lo:400: 00000100:00100000:2.0:1789131150.811264:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131150.811402:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297472 00000100:00100000:3.0:1789131150.811411:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297472 00000100:00100000:3.0:1789131150.811467:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789131150.811476:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002003171d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3306:x1876039910297472:12345-0@lo:400: 00000100:00100000:0.0:1789131150.811684:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1c7a278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910297600:0@lo:400: 00000100:00100000:0.0:1789131150.811733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131150.811780:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297600 00000100:00100000:0.0:1789131150.811784:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297600 00000100:00100000:0.0:1789131150.811817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131150.811824:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081cdf416 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910297600:12345-0@lo:400: 00000100:00100000:0.0:1789131150.811861:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081cdf416 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910297600:12345-0@lo:400: Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131150.811867:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789131150.811915:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b1c7a278 x1876039910297600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131150.811932:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1c7a278 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910297600:0@lo:400: 00000100:00100000:3.0:1789131150.815318:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002003171d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3306:x1876039910297472:12345-0@lo:400: Request processed in 3836us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131150.815354:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131150.815376:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d3ac753d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910297472:0@lo:400: 00010000:00010000:2.0:1789131150.940176:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131151.961841:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131152.985540:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131154.010801:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789131154.860024:0:6702:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789131154.860029:0:6702:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789131154.860131:0:6702:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000a6134463 00000020:01000004:2.0:1789131154.860148:0:6702:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789131154.860158:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789131154.860171:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000f94f789b) 00000020:00000080:2.0:1789131154.860187:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789131154.876829:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1789131154.877061:0:6702:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789131154.899241:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789131154.904987:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789131154.905018:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789131154.905071:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789131154.905093:0:6702:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789131154.905693:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789131154.905704:0:6702:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131154.905713:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9f0de37187904257 00000020:01000004:2.0:1789131154.905721:0:6702:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789131154.905742:0:6702:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789131154.905745:0:6702:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789131154.905750:0:6702:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789131154.905754:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789131154.905764:0:6702:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000065f686a2) 00000020:00000080:2.0:1789131154.905773:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789131154.906935:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131154.907079:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789131154.907084:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789131154.908068:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789131154.908077:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789131154.908726:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789131154.908732:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789131154.911047:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131154.911214:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789131154.911220:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789131154.911991:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789131154.911997:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789131154.934828:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131154.935076:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789131154.935082:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789131154.936980:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789131154.936991:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789131154.938707:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789131154.938719:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789131154.945959:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131154.946289:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789131154.946296:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789131154.947004:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789131154.947012:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789131154.984885:0:6702:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131154.985069:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789131154.985074:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789131154.986129:0:6702:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789131154.986139:0:6702:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789131154.986739:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789131154.986761:0:6702:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789131154.986767:0:6702:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789131155.007702:0:6702:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789131155.007744:0:6702:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789131155.007749:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789131155.007750:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789131155.007751:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789131155.007752:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789131155.007753:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789131155.007755:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789131155.007756:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789131155.007758:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789131155.007759:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789131155.007760:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789131155.007762:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789131155.007765:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789131155.007767:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789131155.007772:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789131155.007773:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789131155.007774:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789131155.007775:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789131155.007776:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789131155.007777:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789131155.007777:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789131155.007778:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789131155.007779:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789131155.007780:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789131155.007805:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789131155.007822:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b87a1f1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910297728:0@lo:253: 00000100:00100000:3.0:1789131155.007903:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.008054:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297728 00000100:00100000:0.0:1789131155.008063:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297728 00000100:00100000:0.0:1789131155.008114:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131155.008122:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1402af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910297728:12345-0@lo:253: 20000000:01000000:0.0:1789131155.008149:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789131155.008152:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789131155.008157:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789131155.008160:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789131155.009098:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131155.009313:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789131155.009362:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789131155.009402:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789131155.009410:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789131155.009440:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789131155.009488:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789131155.009844:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789131155.009861:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1789131155.009869:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1789131155.009907:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789131155.009914:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789131155.009955:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789131155.009962:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1789131155.009988:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789131155.009995:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789131155.010018:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789131155.010062:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789131155.010737:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789131155.010751:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1789131155.010753:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1789131155.010783:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789131155.010791:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789131155.010836:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789131155.010843:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1789131155.010882:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789131155.010891:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789131155.010923:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789131155.010956:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789131155.010971:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789131155.010974:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789131155.010980:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789131155.010981:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789131155.010983:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789131155.010994:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789131155.010997:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789131155.011026:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789131155.011028:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000100:00100000:3.0:1789131155.011445:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000086effd62 going to sleep for 11 seconds 00000040:00080000:0.0:1789131155.012284:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1789131155.012696:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1789131155.013029:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1789131155.013090:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1789131155.013104:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789131155.013106:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789131155.013819:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789131155.013869:0:6718:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789131155.013924:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789131155.014152:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789131155.014192:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789131155.014248:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789131155.014261:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789131155.014262:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789131155.014853:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1789131155.014896:0:6719:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1789131155.014936:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789131155.015178:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1789131155.015222:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1789131155.015257:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:3.0:1789131155.015273:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789131155.015475:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015493:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904185 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015500:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879041a1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015512:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904211 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015519:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015629:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015644:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 11 pid: 5839 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.015656:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000001a522dd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910297856:0@lo:104: 00000100:00100000:3.0:1789131155.015713:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131155.015805:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015813:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 11 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.015821:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f254313b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910297984:0@lo:104: 00000100:00100000:3.0:1789131155.015843:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131155.015936:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.015944:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 11 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.015952:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd673aa2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910298112:0@lo:104: 00000100:00100000:3.0:1789131155.015978:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.016029:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297856 00000100:00100000:0.0:1789131155.016036:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297856 00000100:00100000:0.0:1789131155.016066:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910297984 00000100:00100000:0.0:1789131155.016069:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910297984 00000100:00100000:0.0:1789131155.016080:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131155.016086:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087c41066 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:5839:x1876039910297856:12345-0@lo:104: 00010000:00010000:0.0:1789131155.016097:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.016148:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131155.016153:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087c41066 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:5839:x1876039910297856:12345-0@lo:104: Request processed in 68us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.016160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131155.016176:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131155.016181:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca89d11c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910297984:12345-0@lo:104: 00010000:00010000:0.0:1789131155.016188:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.016220:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789131155.016225:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca89d11c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910297984:12345-0@lo:104: Request processed in 45us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.016230:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789131155.016281:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131155.016286:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016293:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000daa16b1a already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:2.0:1789131155.016296:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016303:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131155.016356:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131155.016362:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131155.016389:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016396:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131155.016412:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016418:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000daa16b1a/0x9f0de37187904211 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904218 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016431:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131155.016434:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016439:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008635d8c1 already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:2.0:1789131155.016441:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016446:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131155.016451:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131155.016456:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131155.016474:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016480:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131155.016484:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016490:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 000000008635d8c1/0x9f0de371879041a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879041a8 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016500:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.016501:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.016502:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131155.016514:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910298240:0@lo:103: 00000100:00100000:2.0:1789131155.016555:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.016578:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131155.016583:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053d86fa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910298368:0@lo:103: 00000100:00100000:2.0:1789131155.016603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.016645:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298240 00000100:00100000:2.0:1789131155.016650:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298240 00010000:00010000:2.0:1789131155.016668:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 12 pid: 5839 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.016686:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298368 00000100:00100000:2.0:1789131155.016688:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298368 00010000:00010000:2.0:1789131155.016697:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 13 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.016706:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131155.016710:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf3c8c5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3308:x1876039910298240:12345-0@lo:103: 00010000:00010000:2.0:1789131155.016727:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131155.016732:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 13 pid: 5839 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016740:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 13 pid: 5839 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016754:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131155.016781:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf3c8c5d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3308:x1876039910298240:12345-0@lo:103: Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.016788:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131155.016801:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131155.016806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e098086 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3308:x1876039910298368:12345-0@lo:103: 00010000:00010000:2.0:1789131155.016813:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131155.016817:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 12 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016824:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 12 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.016834:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131155.016852:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e098086 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3308:x1876039910298368:12345-0@lo:103: Request processed in 46us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.016857:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789131155.016892:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053d86fa6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910298368:0@lo:103: 00000100:00100000:2.0:1789131155.016900:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910298240:0@lo:103: 00000100:00100000:3.0:1789131155.017115:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c84c8a4d going to sleep for 11 seconds 00010000:00010000:3.0:1789131155.017129:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002499f6ed/0x9f0de37187904218 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904211 expref: 11 pid: 5839 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.017139:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000001a522dd pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910297856:0@lo:104: 00010000:00010000:3.0:1789131155.017148:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000080ce7069/0x9f0de371879041a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879041a1 expref: 10 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.017155:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f254313b pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910297984:0@lo:104: 00010000:00010000:3.0:1789131155.017167:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131155.017218:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298112 00000100:00100000:1.0:1789131155.017222:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298112 00000100:00100000:0.0:1789131155.017265:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131155.017273:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba843333 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910298112:12345-0@lo:104: 00010000:00010000:0.0:1789131155.017280:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.017353:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131155.017358:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba843333 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910298112:12345-0@lo:104: Request processed in 88us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.017364:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131155.017426:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd673aa2 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910298112:0@lo:104: 00010000:00010000:3.0:1789131155.017445:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017508:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131155.017512:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017629:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7b1800a already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:2.0:1789131155.017634:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017642:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131155.017647:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131155.017653:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131155.017680:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017686:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131155.017708:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017715:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904185 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790418c expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017731:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.017732:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.017734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131155.017740:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131155.017749:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910298496:0@lo:103: 00000100:00100000:2.0:1789131155.017774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.017801:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298496 00000100:00100000:2.0:1789131155.017805:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298496 00010000:00010000:2.0:1789131155.017822:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 10 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.017840:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131155.017846:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053d86fa6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:3307:x1876039910298496:12345-0@lo:103: 00010000:00010000:2.0:1789131155.017853:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131155.017856:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 10 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017863:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 10 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017874:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a72e1f6/0x9f0de3718790418c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904185 expref: 10 pid: 5838 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017886:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017893:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017905:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017911:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017917:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017922:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017937:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002a41879e already unused, calling callback (00000000eb703e4f) 00010000:00010000:2.0:1789131155.017940:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017946:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017956:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.017964:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131155.017988:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053d86fa6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:3307:x1876039910298496:12345-0@lo:103: Request processed in 143us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.017995:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131155.018017:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910298496:0@lo:103: 00010000:00010000:3.0:1789131155.018066:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.018073:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.018078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a41879e/0x9f0de37187904265 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789131155.018088:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1789131155.034537:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131155.048948:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1402af0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+8:6702:x1876039910297728:12345-0@lo:253: Request processed in 40818us (41036us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.048964:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131155.049212:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b87a1f1d pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910297728:0@lo:253: 10000000:01000000:0.0:1789131155.049227:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789131155.049230:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789131155.049231:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789131155.049233:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131155.049233:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1789131155.049235:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131155.049236:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131155.049237:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131155.049239:0:6702:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789131155.049240:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131155.049241:0:6702:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789131155.049260:0:6702:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000a6134463 from lustre-OST0000 10000000:01000000:0.0:1789131155.049284:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789131155.049287:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789131155.049293:0:6702:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c0c492c0000 local copy 10000000:01000000:0.0:1789131155.049296:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789131155.049640:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.049652:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.049661:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.049679:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298624:0@lo:101: 00000100:00100000:0.0:1789131155.049929:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.050073:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 00000000deda24d5 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.050149:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298624 00000100:00100000:3.0:1789131155.050155:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298624 00000100:00100000:3.0:1789131155.050198:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789131155.050205:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a8925a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+8:6702:x1876039910298624:12345-0@lo:101: 00010000:00010000:3.0:1789131155.050217:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131155.050229:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a41879e/0x9f0de37187904273 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790426c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.050250:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a41879e/0x9f0de37187904273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790426c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.050259:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a41879e/0x9f0de37187904273 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790426c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.050268:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a41879e, rc 0) 00000100:00100000:3.0:1789131155.050307:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a8925a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:6702:x1876039910298624:12345-0@lo:101: Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.050313:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789131155.050408:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298624:0@lo:101: 00010000:00010000:0.0:1789131155.050420:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.050438:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.050651:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298752:0@lo:501: 00000100:00100000:0.0:1789131155.050678:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131155.050736:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298752 00000100:00100000:3.0:1789131155.050740:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298752 00000100:00100000:3.0:1789131155.050773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131155.050780:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004de995e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:6702:x1876039910298752:12345-0@lo:501: 00000100:00100000:3.0:1789131155.050988:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004de995e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:6702:x1876039910298752:12345-0@lo:501: Request processed in 209us (310us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131155.050996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789131155.051138:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 00000000deda24d5 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.051152:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298752:0@lo:501: 10000000:01000000:0.0:1789131155.051164:0:6702:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789131155.051189:0:6702:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789131155.051194:0:6702:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.051201:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.051207:0:6702:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.051264:0:6702:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789131155.051284:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0c43172800 10000000:01000000:0.0:1789131155.051289:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789131155.051294:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c0c492c0000 10000000:01000000:0.0:1789131155.051304:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789131155.051307:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c0c492c0000 from 1 10000000:01000000:0.0:1789131155.051310:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789131155.051361:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.051369:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.051377:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.051389:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298880:0@lo:101: 00000100:00100000:0.0:1789131155.051417:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.051575:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00010000:00010000:2.0:1789131155.051689:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131155.051695:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.051702:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c326496d already unused, calling callback (00000000dd3d3cc1) 10000000:00010000:2.0:1789131155.051705:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.051712:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131155.051718:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131155.051735:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131155.051752:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.051757:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789131155.051804:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910299008:0@lo:103: 00000100:00100000:0.0:1789131155.051831:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.051898:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299008 00000100:00100000:1.0:1789131155.051905:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299008 00000100:00100000:1.0:1789131155.051942:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131155.051949:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b804b172 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:3307:x1876039910299008:12345-0@lo:103: 00010000:00010000:1.0:1789131155.051958:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131155.051970:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a41879e/0x9f0de37187904273 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de3718790426c expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.051986:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131155.052027:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.052035:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000c326496d/0x9f0de3718790426c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de37187904273 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.052046:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.052048:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131155.052049:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131155.052084:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910298880 00000100:00100000:3.0:1789131155.052088:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910298880 00000100:00100000:3.0:1789131155.052118:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789131155.052123:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066138121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:6702:x1876039910298880:12345-0@lo:101: 00010000:00010000:3.0:1789131155.052131:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131155.052145:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000df29cd77/0x9f0de37187904281 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790427a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.052159:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df29cd77/0x9f0de37187904281 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790427a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.052167:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000df29cd77/0x9f0de37187904281 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790427a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.052174:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000df29cd77, rc 0) 00000100:00100000:3.0:1789131155.052200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066138121 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910298880:12345-0@lo:101: Request processed in 77us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.052206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789131155.052311:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b804b172 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:3307:x1876039910299008:12345-0@lo:103: Request processed in 362us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.052477:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131155.052588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028aa4568 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910299008:0@lo:103: 00000100:00100000:0.0:1789131155.052614:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910298880:0@lo:101: 00010000:00010000:0.0:1789131155.052635:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.052643:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131155.052655:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789131155.052695:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.052712:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000179c120a/0x9f0de3718790427a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131155.052719:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789131155.052722:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131155.052726:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789131155.052728:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789131155.052742:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.052748:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.052754:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.052764:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299136:0@lo:101: 00000100:00100000:0.0:1789131155.052788:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.052813:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.052851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299136 00000100:00100000:2.0:1789131155.052856:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299136 00000100:00100000:2.0:1789131155.052881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131155.052886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000367ec7dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+9:6702:x1876039910299136:12345-0@lo:101: 00010000:00010000:2.0:1789131155.052892:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131155.052900:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a72e1f6/0x9f0de3718790428f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904288 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.052912:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a72e1f6/0x9f0de3718790428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904288 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.052919:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a72e1f6/0x9f0de3718790428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904288 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.052925:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a72e1f6, rc 0) 00000100:00100000:2.0:1789131155.052962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000367ec7dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299136:12345-0@lo:101: Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.052969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131155.053025:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299136:0@lo:101: 00010000:00010000:0.0:1789131155.053033:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.053039:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.053106:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299264:0@lo:501: 00000100:00100000:0.0:1789131155.053132:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.053151:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.053187:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299264 00000100:00100000:2.0:1789131155.053191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299264 00000100:00100000:2.0:1789131155.053214:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131155.053218:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000af38308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299264:12345-0@lo:501: 00000100:00100000:2.0:1789131155.053417:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000af38308 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299264:12345-0@lo:501: Request processed in 198us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.053434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789131155.053544:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299264:0@lo:501: 00000100:00100000:0.0:1789131155.053566:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299392:0@lo:503: 00000100:00100000:0.0:1789131155.053597:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.053629:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.053714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299392 00000100:00100000:2.0:1789131155.053718:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299392 00000100:00100000:2.0:1789131155.053741:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131155.053746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000484aacd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299392:12345-0@lo:503: 00000100:00100000:2.0:1789131155.053867:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000484aacd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299392:12345-0@lo:503: Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.053873:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789131155.053970:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299392:0@lo:503: 00000040:00080000:0.0:1789131155.054179:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789131155.054230:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299520:0@lo:502: 00000100:00100000:0.0:1789131155.054261:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.054282:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.054345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299520 00000100:00100000:2.0:1789131155.054349:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299520 00000100:00100000:2.0:1789131155.054372:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789131155.054377:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d256b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299520:12345-0@lo:502: 00000100:00100000:2.0:1789131155.054494:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d256b27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299520:12345-0@lo:502: Request processed in 117us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.054501:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131155.054692:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299520:0@lo:502: 00000040:00080000:0.0:1789131155.054908:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789131155.054948:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789131155.054974:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789131155.055010:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789131155.055038:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789131155.055062:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789131155.055079:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299648:0@lo:502: 00000100:00100000:0.0:1789131155.055109:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.055136:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077b442bf going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.055178:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299648 00000100:00100000:2.0:1789131155.055181:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299648 00000100:00100000:2.0:1789131155.055211:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131155.055216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002443e371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299648:12345-0@lo:502: 00000100:00100000:2.0:1789131155.055356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002443e371 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299648:12345-0@lo:502: Request processed in 141us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.055363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789131155.055732:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299648:0@lo:502: 00000040:00080000:0.0:1789131155.055811:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789131155.055821:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789131155.056223:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789131155.056229:0:6720:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789131155.056233:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131155.056235:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789131155.056238:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131155.056253:0:6720:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000300bd9c8) 00000020:00000080:1.0:1789131155.056268:0:6720:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789131155.056273:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789131155.056317:0:6720:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000a6134463 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789131155.056338:0:6720:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789131155.056345:0:6720:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9f0de3718790429d 00010000:00010000:0.0:1789131155.060945:0:6720:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789131155.061234:0:6720:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789131155.063638:0:6720:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789131155.063947:0:6720:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789131155.070141:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789131155.070802:0:6720:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789131155.072148:0:6720:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789131155.072160:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131155.072166:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.072168:0:6720:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789131155.072171:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131155.072175:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.072176:0:6720:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789131155.072179:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789131155.072181:0:6720:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789131155.072218:0:6720:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131155.072221:0:6720:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.072222:0:6720:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789131155.072225:0:6720:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789131155.072494:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789131155.072516:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789131155.072538:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.072551:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000d7b1800a/0x9f0de37187904288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131155.072559:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172800 from 1 10000000:01000000:1.0:1789131155.072562:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131155.072595:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000a452d9ff/0x9f0de371879042a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.072602:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000a452d9ff/0x9f0de371879042a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.072611:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000a452d9ff/0x9f0de371879042a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.072651:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd1a6a68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299776:0@lo:101: 00000100:00100000:1.0:1789131155.072714:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.072753:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010c24b95 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.072825:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299776 00000100:00100000:3.0:1789131155.072832:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299776 00000100:00100000:3.0:1789131155.072876:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789131155.072884:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffa68d0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+10:6702:x1876039910299776:12345-0@lo:101: 00010000:00010000:3.0:1789131155.072896:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131155.072908:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021374633/0x9f0de371879042ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879042a4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.072928:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021374633/0x9f0de371879042ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879042a4 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.072938:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021374633/0x9f0de371879042ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042a4 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.072946:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021374633, rc 0) 00000100:00100000:3.0:1789131155.072982:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffa68d0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910299776:12345-0@lo:101: Request processed in 99us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.072998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789131155.073120:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd1a6a68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299776:0@lo:101: 00010000:00010000:1.0:1789131155.073133:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000a452d9ff/0x9f0de371879042a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.073140:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000a452d9ff/0x9f0de371879042a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.073215:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fd1a6a68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299904:0@lo:501: 00000100:00100000:1.0:1789131155.073237:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.073256:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000010c24b95 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.073271:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910299904 00000100:00100000:1.0:1789131155.073276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910299904 00000100:00100000:1.0:1789131155.073302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789131155.073307:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bcf7d303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910299904:12345-0@lo:501: 00000100:00100000:1.0:1789131155.073665:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bcf7d303 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910299904:12345-0@lo:501: Request processed in 356us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.073672:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131155.073739:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fd1a6a68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910299904:0@lo:501: 00000100:00100000:0.0:1789131155.073767:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300032:0@lo:503: 00000100:00100000:0.0:1789131155.073807:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.073833:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c4bb303e going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.073877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300032 00000100:00100000:1.0:1789131155.073882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300032 00000100:00100000:1.0:1789131155.073938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789131155.073945:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000657df78f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300032:12345-0@lo:503: 00000100:00100000:1.0:1789131155.074179:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000657df78f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300032:12345-0@lo:503: Request processed in 235us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.074195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131155.077910:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300032:0@lo:503: 00000040:00080000:0.0:1789131155.078223:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789131155.078291:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300160:0@lo:502: 00000100:00100000:0.0:1789131155.078380:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.078416:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069781586 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.078526:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300160 00000100:00100000:1.0:1789131155.078532:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300160 00000100:00100000:1.0:1789131155.078565:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789131155.078573:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005983e71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300160:12345-0@lo:502: 00000100:00100000:1.0:1789131155.078793:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005983e71a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300160:12345-0@lo:502: Request processed in 221us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.078801:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131155.078893:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300160:0@lo:502: 00000040:00080000:0.0:1789131155.079126:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789131155.079173:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789131155.079204:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300288:0@lo:502: 00000100:00100000:0.0:1789131155.079238:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.079263:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069781586 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.079349:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300288 00000100:00100000:3.0:1789131155.079354:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300288 00000100:00100000:3.0:1789131155.079381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789131155.079387:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bc2bbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300288:12345-0@lo:502: 00000100:00100000:3.0:1789131155.079528:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bc2bbcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300288:12345-0@lo:502: Request processed in 140us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.079535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789131155.079802:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005627d737 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300288:0@lo:502: 00000040:00080000:0.0:1789131155.079898:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789131155.079908:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789131155.080419:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131155.080428:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131155.080431:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789131155.080437:0:6724:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43172800 00000020:00000080:2.0:1789131155.080440:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131155.080476:0:6724:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131155.080480:0:6724:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131155.080481:0:6724:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789131155.080484:0:6724:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789131155.080552:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789131155.080569:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131155.080586:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.080598:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131155.080644:0:6702:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789131155.080647:0:6702:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0c43172800 10000000:01000000:1.0:1789131155.080650:0:6702:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0c43172800 10000000:01000000:1.0:1789131155.080654:0:6702:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131155.080659:0:6702:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43172800 from 1 10000000:01000000:1.0:1789131155.080662:0:6702:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789131155.080692:0:6702:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.080699:0:6702:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.080707:0:6702:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.080728:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300416:0@lo:101: 00000100:00100000:1.0:1789131155.080774:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.080804:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.081388:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300416 00000100:00100000:3.0:1789131155.081395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300416 00000100:00100000:3.0:1789131155.081437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789131155.081446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910300416:12345-0@lo:101: 00010000:00010000:3.0:1789131155.081457:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131155.081469:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879042b2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.081492:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879042b2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.081502:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042b2 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.081511:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8a00, rc 0) 00000100:00100000:3.0:1789131155.081553:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300416:12345-0@lo:101: Request processed in 108us (779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.081560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789131155.081668:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300416:0@lo:101: 00010000:00010000:1.0:1789131155.081682:0:6702:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.081690:0:6702:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.081772:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300544:0@lo:501: 00000100:00100000:1.0:1789131155.081800:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.082125:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.082193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300544 00000100:00100000:2.0:1789131155.082198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300544 00000100:00100000:2.0:1789131155.082226:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789131155.082233:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300544:12345-0@lo:501: 00000100:00100000:2.0:1789131155.082579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300544:12345-0@lo:501: Request processed in 345us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.082586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789131155.082642:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300544:0@lo:501: 00000100:00100000:1.0:1789131155.082672:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300672:0@lo:503: 00000100:00100000:1.0:1789131155.082708:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.082881:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.082949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300672 00000100:00100000:2.0:1789131155.082953:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300672 00000100:00100000:2.0:1789131155.082984:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789131155.082991:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300672:12345-0@lo:503: 00000100:00100000:2.0:1789131155.083134:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300672:12345-0@lo:503: Request processed in 142us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.083141:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789131155.083214:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300672:0@lo:503: 00000040:00080000:1.0:1789131155.083729:0:6702:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131155.083788:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300800:0@lo:502: 00000100:00100000:1.0:1789131155.083825:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.083886:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.083925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300800 00000100:00100000:2.0:1789131155.083930:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300800 00000100:00100000:2.0:1789131155.083992:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789131155.084008:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300800:12345-0@lo:502: 00000100:00100000:2.0:1789131155.084233:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300800:12345-0@lo:502: Request processed in 226us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.084240:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789131155.087963:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a730c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300800:0@lo:502: 00000040:00080000:0.0:1789131155.088284:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789131155.088515:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789131155.088552:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789131155.088597:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789131155.088644:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789131155.088692:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789131155.088727:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789131155.088759:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789131155.088805:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789131155.088840:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789131155.088876:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789131155.088949:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789131155.088986:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789131155.089018:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789131155.089059:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789131155.089091:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789131155.089121:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789131155.089163:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789131155.089196:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789131155.089227:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789131155.089269:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789131155.089301:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789131155.089503:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789131155.089574:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789131155.089611:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789131155.089659:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789131155.089717:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789131155.089765:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789131155.089810:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300928:0@lo:502: 00000100:00100000:0.0:1789131155.089882:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.090072:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fc51780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.090123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910300928 00000100:00100000:2.0:1789131155.090130:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910300928 00000100:00100000:2.0:1789131155.090209:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789131155.090218:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300928:12345-0@lo:502: 00000100:00100000:2.0:1789131155.090618:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910300928:12345-0@lo:502: Request processed in 400us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.090640:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789131155.090733:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910300928:0@lo:502: 00000040:00080000:3.0:1789131155.090828:0:6702:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789131155.090839:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789131155.091408:0:6725:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789131155.091433:0:6725:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c0c76120000) 00000020:00000080:3.0:1789131155.091456:0:6725:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1789131155.091543:0:6725:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43172800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131155.091547:0:6725:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43172800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131155.091550:0:6725:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43172800 3 00010000:00080000:3.0:1789131155.091579:0:6725:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0b41aeb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1789131155.093153:0:6725:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1789131155.093376:0:6725:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789131155.093407:0:6725:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789131155.093418:0:6725:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9f0de371879042c7 00000100:00080000:3.0:1789131155.093427:0:6725:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789131155.093432:0:6725:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c0b41aeb000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131155.093462:0:6725:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c55ac4000 x1876039910301056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131155.093485:0:6725:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789131155.095315:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910301184:0@lo:400: 00000100:00100000:2.0:1789131155.095395:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.095553:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910301056:0@lo:38: 00000100:00100000:1.0:1789131155.095586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.095647:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301184 00000100:00100000:1.0:1789131155.095654:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301184 00000100:00100000:1.0:1789131155.095690:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301056 00000100:00100000:1.0:1789131155.095693:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301056 00000100:00100000:1.0:1789131155.095705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131155.095713:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910301184:12345-0@lo:400: 00000100:00100000:1.0:1789131155.095758:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910301184:12345-0@lo:400: Request processed in 45us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.095765:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131155.095781:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131155.095786:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910301056:12345-0@lo:38: 00010000:00080000:1.0:1789131155.095806:0:5846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:1.0:1789131155.095845:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9f0de371879042ce 00000004:00100000:1.0:1789131155.095861:0:5846:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789131155.095893:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9c0c772ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131155.095931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876039910301056:12345-0@lo:38: Request processed in 143us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.095937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789131155.095979:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0c55ac4000 x1876039910301056/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131155.095990:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131155.095997:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1789131155.096003:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789131155.096007:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789131155.096010:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789131155.096015:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910301056:0@lo:38: 00010000:00080000:2.0:1789131155.096529:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0c5684b840 x1876039910301184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131155.096540:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910301184:0@lo:400: 00000040:00080000:2.0:1789131155.097653:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789131155.097788:0:6702:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789131155.097819:0:6702:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131155.097837:0:6702:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.097849:0:6702:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789131155.097894:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789131155.097895:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131155.097897:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131155.097898:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131155.097899:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131155.097901:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131155.097902:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131155.097903:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789131155.097905:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789131155.097906:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131155.097908:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131155.097911:0:6702:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789131155.097914:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131155.097916:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131155.097917:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131155.097917:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131155.097918:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131155.097920:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131155.097921:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131155.097922:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789131155.097922:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789131155.097923:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131155.097924:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789131155.097946:0:6702:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789131155.097960:0:6702:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910301312:0@lo:253: 00000100:00100000:1.0:1789131155.098012:0:6702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.098042:0:6702:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.098160:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301312 00000100:00100000:2.0:1789131155.098166:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301312 00000100:00100000:2.0:1789131155.098208:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789131155.098216:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6702:x1876039910301312:12345-0@lo:253: 20000000:01000000:2.0:1789131155.098240:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789131155.098252:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789131155.122418:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789131155.122436:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789131155.122542:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789131155.122547:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789131155.122568:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.122606:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.122616:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.122663:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.122678:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.122691:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910301440:0@lo:104: 00000100:00100000:2.0:1789131155.122750:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.122802:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c44f9f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.122858:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301440 00000100:00100000:0.0:1789131155.122865:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301440 00000100:00100000:0.0:1789131155.122912:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131155.122921:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910301440:12345-0@lo:104: 00010000:00010000:0.0:1789131155.122933:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.122990:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131155.122996:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910301440:12345-0@lo:104: Request processed in 77us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1789131155.123002:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1789131155.123003:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789131155.123008:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.123015:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131155.123019:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.123028:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131155.123042:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131155.123048:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789131155.123080:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.123087:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131155.123111:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.123118:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030400/0x9f0de3718790423b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904242 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.123132:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131155.123134:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131155.123136:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131155.123142:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131155.123152:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910301568:0@lo:103: 00000100:00100000:3.0:1789131155.123196:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.123240:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301568 00000100:00100000:0.0:1789131155.123245:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301568 00010000:00010000:0.0:1789131155.123260:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 13 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.123288:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131155.123295:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3308:x1876039910301568:12345-0@lo:103: 00010000:00010000:0.0:1789131155.123304:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131155.123310:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 13 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123363:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 13 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123378:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123386:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789131155.123398:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001151393s 00010000:00010000:0.0:1789131155.123401:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123408:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123413:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123419:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123424:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131155.123428:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123435:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123444:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.123463:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131155.123490:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493c7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3308:x1876039910301568:12345-0@lo:103: Request processed in 196us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.123497:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789131155.123563:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b9400/0x9f0de37187904242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790423b expref: 12 pid: 5839 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.123585:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910301440:0@lo:104: 00010000:00010000:1.0:1789131155.123601:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.123609:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.123615:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.123630:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879042d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.123721:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910301568:0@lo:103: 00000100:00100000:3.0:1789131155.135382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:6702:x1876039910301312:12345-0@lo:253: Request processed in 37159us (37362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.135397:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789131155.135574:0:6702:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:6702:1876039910301312:0@lo:253: 10000000:01000000:1.0:1789131155.135586:0:6702:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789131155.135589:0:6702:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131155.135591:0:6702:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131155.135591:0:6702:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131155.135592:0:6702:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131155.135593:0:6702:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131155.135594:0:6702:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131155.135595:0:6702:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131155.135596:0:6702:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789131155.135597:0:6702:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789131155.135598:0:6702:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131155.135599:0:6702:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789131155.135610:0:6702:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789131155.140735:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1789131155.140920:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789131155.141114:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1789131155.141309:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789131155.141956:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:1.0:1789131155.142914:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789131155.144101:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789131155.338812:0:6702:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789131155.338819:0:6702:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789131155.338856:0:6702:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789131155.338919:0:6702:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789131155.338933:0:6702:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789131155.338962:0:6702:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:0.0:1789131155.801460:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789131155.801468:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43124000 from 21 10000000:01000000:0.0:1789131155.801473:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131155.801690:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.801702:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.801713:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.801736:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301696:0@lo:101: 00000100:00100000:0.0:1789131155.801803:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.801871:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42d9c180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.802208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301696 00000100:00100000:2.0:1789131155.802216:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301696 00000100:00100000:2.0:1789131155.802274:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131155.802283:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5842:x1876039910301696:12345-0@lo:101: 00010000:00010000:2.0:1789131155.802302:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131155.802317:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879042dc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.802385:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879042dc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.802396:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042dc expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.802405:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc800, rc 0) 00000100:00100000:3.0:1789131155.802501:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301696:0@lo:101: 00010000:00010000:3.0:1789131155.802517:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.802536:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.802587:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301824:0@lo:501: 00000100:00100000:3.0:1789131155.802627:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.802647:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910301696:12345-0@lo:101: Request processed in 195us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.802650:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5021af00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.802656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789131155.802666:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301824 00000100:00100000:3.0:1789131155.802671:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301824 00000100:00100000:3.0:1789131155.802691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789131155.802698:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910301824:12345-0@lo:501: 00000100:00100000:3.0:1789131155.803352:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910301824:12345-0@lo:501: Request processed in 653us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.803724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789131155.804090:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301824:0@lo:501: 00000100:00100000:2.0:1789131155.804133:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301952:0@lo:503: 00000100:00100000:2.0:1789131155.804180:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.804213:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.804255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910301952 00000100:00100000:1.0:1789131155.804260:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910301952 00000100:00100000:1.0:1789131155.804291:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789131155.804301:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910301952:12345-0@lo:503: 00000100:00100000:1.0:1789131155.804664:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910301952:12345-0@lo:503: Request processed in 364us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.804672:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789131155.805898:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910301952:0@lo:503: 00000100:00100000:2.0:1789131155.809587:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6750:1876039910302080:0@lo:502: 00000100:00100000:2.0:1789131155.809681:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.809721:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.809815:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302080 00000100:00100000:3.0:1789131155.809823:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302080 00000100:00100000:3.0:1789131155.809879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789131155.809888:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6750:x1876039910302080:12345-0@lo:502: 00000100:00100000:3.0:1789131155.810185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6750:x1876039910302080:12345-0@lo:502: Request processed in 297us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.810193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789131155.810736:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6750:1876039910302080:0@lo:502: 00000100:00100000:2.0:1789131155.810793:0:6750:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6750:1876039910302208:0@lo:502: 00000100:00100000:2.0:1789131155.810830:0:6750:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.810850:0:6750:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.811165:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302208 00000100:00100000:3.0:1789131155.811171:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302208 00000100:00100000:3.0:1789131155.811206:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131155.811214:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6750:x1876039910302208:12345-0@lo:502: 00000100:00100000:3.0:1789131155.811407:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:6750:x1876039910302208:12345-0@lo:502: Request processed in 193us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.811436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789131155.812141:0:6750:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6750:1876039910302208:0@lo:502: 00000040:00080000:2.0:1789131155.812171:0:6750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1789131155.812661:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1789131155.812684:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789131155.812694:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.812705:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131155.812715:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789131155.812718:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43124000 from 4 10000000:01000000:1.0:1789131155.812720:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789131155.812751:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.812759:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.812769:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131155.812784:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302336:0@lo:101: 00000100:00100000:1.0:1789131155.812832:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.812876:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.813610:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302336 00000100:00100000:3.0:1789131155.813625:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302336 00000100:00100000:3.0:1789131155.813669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131155.813677:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910302336:12345-0@lo:101: 00010000:00010000:3.0:1789131155.813689:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131155.813701:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879042ea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.813722:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879042ea expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.813732:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042ea expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131155.813739:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8000, rc 0) 00000100:00100000:3.0:1789131155.813790:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910302336:12345-0@lo:101: Request processed in 114us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.813797:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789131155.814264:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302336:0@lo:101: 00010000:00010000:2.0:1789131155.814281:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.814290:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.814370:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302464:0@lo:256: 00000100:00100000:2.0:1789131155.814407:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.814449:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.814944:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302464 00000100:00100000:1.0:1789131155.814950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302464 00000100:00100000:1.0:1789131155.814981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789131155.814988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910302464:12345-0@lo:256: 20000000:01000000:1.0:1789131155.815003:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131155.815017:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131155.815020:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789131155.815645:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910302464:12345-0@lo:256: Request processed in 655us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.815655:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789131155.816078:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302464:0@lo:256: 10000000:01000000:2.0:1789131155.816130:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131155.816139:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.816150:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131155.816158:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789131155.816160:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789131155.816163:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789131155.816189:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.816197:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.816205:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.816233:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302592:0@lo:101: 00000100:00100000:2.0:1789131155.816267:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.816301:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.816362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302592 00000100:00100000:1.0:1789131155.816368:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302592 00000100:00100000:1.0:1789131155.816408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789131155.816425:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910302592:12345-0@lo:101: 00010000:00010000:1.0:1789131155.816442:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131155.816455:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879042f8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.817610:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879042f8 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.817638:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042f8 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.817648:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7c00, rc 0) 00000100:00100000:1.0:1789131155.817710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910302592:12345-0@lo:101: Request processed in 1294us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.817730:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789131155.817905:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302592:0@lo:101: 00010000:00010000:2.0:1789131155.817925:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.817934:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.817995:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302720:0@lo:501: 00000100:00100000:2.0:1789131155.818027:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.818067:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.818534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302720 00000100:00100000:1.0:1789131155.818541:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302720 00000100:00100000:1.0:1789131155.818627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789131155.818636:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910302720:12345-0@lo:501: 00000100:00100000:1.0:1789131155.818899:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910302720:12345-0@lo:501: Request processed in 262us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.818906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789131155.818984:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302720:0@lo:501: 00000100:00100000:2.0:1789131155.819015:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302848:0@lo:503: 00000100:00100000:2.0:1789131155.819068:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.824246:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.824329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302848 00000100:00100000:3.0:1789131155.824342:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302848 00000100:00100000:3.0:1789131155.824388:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789131155.824397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910302848:12345-0@lo:503: 00000100:00100000:3.0:1789131155.824788:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910302848:12345-0@lo:503: Request processed in 391us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.824797:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789131155.825252:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910302848:0@lo:503: 00000100:00100000:3.0:1789131155.825594:0:6752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6752:1876039910302976:0@lo:502: 00000100:00100000:3.0:1789131155.825653:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131155.825682:0:6752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5021a540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.825717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910302976 00000100:00100000:0.0:1789131155.825723:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910302976 00000100:00100000:0.0:1789131155.825752:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789131155.825760:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:6752:x1876039910302976:12345-0@lo:502: 00000100:00100000:0.0:1789131155.826020:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:6752:x1876039910302976:12345-0@lo:502: Request processed in 260us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.826028:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789131155.827256:0:6752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6752:1876039910302976:0@lo:502: 00000020:01000000:3.0:1789131155.827289:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789131155.827295:0:6752:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789131155.827302:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131155.827304:0:6752:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789131155.827309:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789131155.827312:0:6752:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1789131155.827632:0:6752:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789131155.827636:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131155.827650:0:6752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c0c76123490) 00000020:00000080:3.0:1789131155.827782:0:6752:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789131155.827790:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789131155.827864:0:6752:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789131155.827869:0:6752:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789131155.827889:0:6752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790430d 00010000:00080000:3.0:1789131155.827918:0:6752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0c81e72000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1789131155.830500:0:6752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789131155.869604:0:6752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789131155.869669:0:6752:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789131155.871568:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131155.871847:0:6752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131155.871890:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789131155.871935:0:6752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789131155.872437:0:6755:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131155.874348:0:6755:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789131155.875606:0:6752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131155.875633:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789131155.875672:0:6752:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789131155.875760:0:6752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187904314 00000100:00080000:1.0:1789131155.875770:0:6752:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131155.875775:0:6752:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c0c81e72000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131155.875809:0:6752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c55a72940 x1876039910303104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131155.875874:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910303104:0@lo:8: 00000100:00100000:2.0:1789131155.875941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789131155.875993:0:6752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789131155.876052:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131155.876056:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131155.876058:0:6752:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789131155.876060:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131155.876072:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131155.876073:0:6752:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789131155.876077:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131155.876079:0:6752:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789131155.876100:0:6752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6752:1876039910303232:0@lo:502: 00000100:00100000:1.0:1789131155.876142:0:6752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.876179:0:6752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3000 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.876264:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303104 00000100:00100000:3.0:1789131155.876271:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303104 00000100:00100000:0.0:1789131155.876556:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303232 00000100:00100000:0.0:1789131155.876561:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303232 00000100:00100000:0.0:1789131155.876599:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789131155.876607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:6752:x1876039910303232:12345-0@lo:502: 00000100:00100000:0.0:1789131155.876823:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:6752:x1876039910303232:12345-0@lo:502: Request processed in 216us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.876830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789131155.876881:0:6752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6752:1876039910303232:0@lo:502: 00000020:01000000:0.0:1789131155.876904:0:6752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131155.876908:0:6752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.876909:0:6752:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789131155.876913:0:6752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789131155.876993:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789131155.877017:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789131155.877027:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.877042:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131155.877051:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789131155.877054:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 1 10000000:01000000:1.0:1789131155.877057:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00100000:3.0:1789131155.877079:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789131155.877080:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131155.877085:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1876039910303104:12345-0@lo:8: 00010000:00010000:1.0:1789131155.877088:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131155.877096:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789131155.877104:0:6704:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000100:00100000:1.0:1789131155.877107:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303360:0@lo:101: 00000020:00000080:3.0:1789131155.877127:0:6704:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187904322 00000100:00100000:1.0:1789131155.877132:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.877152:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3180 going to sleep for 11 seconds 00002000:00100000:3.0:1789131155.877154:0:6704:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c0c81e77000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789131155.877159:0:6704:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789131155.877168:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1789131155.877264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303360 00000100:00100000:2.0:1789131155.877269:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303360 00000100:00100000:2.0:1789131155.877338:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131155.877346:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910303360:12345-0@lo:101: 00010000:00010000:2.0:1789131155.877361:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131155.877372:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790431b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.877394:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790431b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.877403:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790431b expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.877411:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fd600, rc 0) 00000100:00100000:2.0:1789131155.877459:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910303360:12345-0@lo:101: Request processed in 114us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.877465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131155.877657:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303360:0@lo:101: 00010000:00010000:2.0:1789131155.877669:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131155.877736:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131155.877777:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56848f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303488:0@lo:501: 00000100:00100000:2.0:1789131155.877801:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.877827:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131155.877873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303488 00000100:00100000:1.0:1789131155.877882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303488 00000100:00100000:1.0:1789131155.877939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131155.877973:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910303488:12345-0@lo:501: 00002000:00100000:3.0:1789131155.878113:0:6704:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789131155.878311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910303488:12345-0@lo:501: Request processed in 365us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131155.878318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00002000:00080000:3.0:1789131155.878355:0:6704:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789131155.878385:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e71800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131155.878545:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1876039910303104:12345-0@lo:8: Request processed in 1458us (2603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.878553:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789131155.878635:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9c0c55a72940 x1876039910303104/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131155.878663:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789131155.878669:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789131155.878779:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789131155.878793:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789131155.878797:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e72000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789131155.878823:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789131155.878829:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910303104:0@lo:8: 00000004:00080000:2.0:1789131155.878865:0:6755:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789131155.879029:0:6755:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167852706497ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789131155.880396:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56848f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303488:0@lo:501: 00000100:00100000:0.0:1789131155.880447:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303616:0@lo:503: 00000100:00100000:0.0:1789131155.880519:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.880550:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c7a40aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.880566:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303616 00000100:00100000:0.0:1789131155.880572:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303616 00000100:00100000:0.0:1789131155.880672:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789131155.880680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910303616:12345-0@lo:503: 00000100:00100000:0.0:1789131155.880970:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910303616:12345-0@lo:503: Request processed in 290us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.880977:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789131155.881164:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910303616:0@lo:503: 00000100:00100000:0.0:1789131155.882688:0:6757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6757:1876039910303744:0@lo:502: 00000100:00100000:0.0:1789131155.882749:0:6757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.882785:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303744 00000100:00100000:0.0:1789131155.882791:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303744 00000100:00100000:0.0:1789131155.882833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789131155.882840:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:6757:x1876039910303744:12345-0@lo:502: 00000100:00100000:0.0:1789131155.883021:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:6757:x1876039910303744:12345-0@lo:502: Request processed in 180us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.883028:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789131155.883071:0:6757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.883087:0:6757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6757:1876039910303744:0@lo:502: 00000020:01000000:0.0:1789131155.883111:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131155.883119:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.883122:0:6757:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789131155.883128:0:6757:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43124000 00000020:00000080:0.0:1789131155.883131:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789131155.883150:0:6757:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6757:1876039910303872:0@lo:502: 00000100:00100000:0.0:1789131155.883180:0:6757:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.883200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910303872 00000100:00100000:0.0:1789131155.883204:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910303872 00000100:00100000:0.0:1789131155.884337:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789131155.884349:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:6757:x1876039910303872:12345-0@lo:502: 00000100:00100000:0.0:1789131155.884645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:6757:x1876039910303872:12345-0@lo:502: Request processed in 299us (1463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.884652:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789131155.889563:0:6757:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.889605:0:6757:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:6757:1876039910303872:0@lo:502: 00000020:01000000:0.0:1789131155.889657:0:6757:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131155.889665:0:6757:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131155.889667:0:6757:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789131155.889672:0:6757:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1789131155.889734:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789131155.889760:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131155.889769:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.889779:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131155.889789:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789131155.889792:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c0c492c0000 from 1 10000000:01000000:0.0:1789131155.889794:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789131155.889822:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.889830:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.889840:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.889858:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910304000:0@lo:101: 00000100:00100000:0.0:1789131155.889919:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.889940:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.889955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304000 00000100:00100000:0.0:1789131155.889959:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304000 00000100:00100000:0.0:1789131155.889993:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789131155.890001:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910304000:12345-0@lo:101: 00010000:00010000:0.0:1789131155.890013:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131155.890025:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904330 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.890057:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.890067:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.890076:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40030a00, rc 0) 00000100:00100000:0.0:1789131155.890123:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910304000:12345-0@lo:101: Request processed in 121us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.890130:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789131155.890162:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910304000:0@lo:101: 00010000:00010000:0.0:1789131155.890174:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.890183:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131155.890516:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910304128:0@lo:501: 00000100:00100000:0.0:1789131155.890552:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.890575:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131155.890586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304128 00000100:00100000:0.0:1789131155.890590:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304128 00000100:00100000:0.0:1789131155.890626:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789131155.890633:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910304128:12345-0@lo:501: 00000100:00100000:0.0:1789131155.890834:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910304128:12345-0@lo:501: Request processed in 201us (280us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131155.890840:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789131155.890878:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910304128:0@lo:501: 10000000:01000000:0.0:1789131155.890897:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789131155.890902:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131155.890910:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789131155.934812:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1789131155.934939:0:6756:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789131155.934958:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131155.934965:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304384:0@lo:7: 00000100:00100000:0.0:1789131155.934969:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910304256:0@lo:13: 00000100:00100000:1.0:1789131155.935709:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131155.935758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.935787:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47f44d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.935842:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304256 00000100:00100000:3.0:1789131155.935859:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304256 00000100:00100000:3.0:1789131155.935915:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131155.935924:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910304256:12345-0@lo:13: 00002000:00000024:3.0:1789131155.935943:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00080000:1.0:1789131155.936010:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131155.936077:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910304256:12345-0@lo:13: Request processed in 154us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131155.936085:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131155.936147:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304384 00000100:00100000:2.0:1789131155.936152:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304384 00010000:00080000:0.0:1789131155.936174:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9c0c55a72580 x1876039910304256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131155.936193:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910304256:0@lo:13: 00000100:00100000:2.0:1789131155.936718:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131155.936727:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6756:x1876039910304384:12345-0@lo:7: 00002000:00080000:2.0:1789131155.942686:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789131155.942694:0:6706:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789131155.942781:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6756:x1876039910304384:12345-0@lo:7: Request processed in 6052us (7071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131155.942792:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789131155.942882:0:6756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9c0c55a70000 x1876039910304384/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789131171 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131155.942896:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304384:0@lo:7: 00000004:00080000:1.0:1789131155.942908:0:6756:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789131155.942943:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304512:0@lo:5: 00000100:00100000:1.0:1789131155.942973:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.943017:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47f44d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.943081:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304512 00000100:00100000:3.0:1789131155.943087:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304512 00000100:00100000:3.0:1789131155.943131:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131155.943140:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6756:x1876039910304512:12345-0@lo:5: 00002000:00080000:3.0:1789131155.943161:0:6704:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789131155.943165:0:6704:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789131155.943738:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6756:x1876039910304512:12345-0@lo:5: Request processed in 598us (762us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789131155.943745:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789131155.943790:0:6756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=0) req@ffff9c0c55a70000 x1876039910304512/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131171 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131155.943803:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a70000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304512:0@lo:5: 00000004:00080000:1.0:1789131155.943811:0:6756:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789131155.943835:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a70b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304640:0@lo:700: 00000100:00100000:1.0:1789131155.943861:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131155.943911:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47f44d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131155.943954:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304640 00000100:00100000:2.0:1789131155.943959:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304640 00000100:00100000:2.0:1789131155.944020:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131155.944027:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6756:x1876039910304640:12345-0@lo:700: 00000100:00100000:2.0:1789131155.944055:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1876039910304768:0@lo:700: 00000100:00100000:2.0:1789131155.944097:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131155.944159:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12300 going to sleep for 11 seconds 00000100:00100000:3.0:1789131155.944283:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304768 00000100:00100000:3.0:1789131155.944287:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304768 00000100:00100000:3.0:1789131155.944527:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131155.944536:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1876039910304768:12345-0@lo:700: 00000100:00080000:1.0:1789131155.945199:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 40000000:02000000:0.0:1789131155.962172:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789131155.969045:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6713:x1876039910304768:12345-0@lo:700: Request processed in 24503us (24939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131155.969064:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789131155.969297:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0c56849e00 x1876039910304768/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789131171 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131155.969343:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6713:1876039910304768:0@lo:700: 40000000:02000000:2.0:1789131155.969356:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1789131156.058317:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789131156.062121:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789131156.062139:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789131156.062427:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a71e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6756:x1876039910304640:12345-0@lo:700: Request processed in 118386us (118551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131156.062453:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789131156.062564:0:6756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a70b40 x1876039910304640/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789131171 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131156.062576:0:6756:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789131156.062592:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a70b40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304640:0@lo:700: 00000004:02000040:0.0:1789131156.087997:0:6756:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789131156.094017:0:6756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304896:0@lo:5: 00000100:00100000:0.0:1789131156.094086:0:6756:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131156.094185:0:6756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131156.095774:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910304896 00000100:00100000:1.0:1789131156.095785:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910304896 00000100:00100000:1.0:1789131156.095842:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789131156.095852:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6756:x1876039910304896:12345-0@lo:5: 00002000:00080000:1.0:1789131156.104838:0:6706:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789131156.104858:0:6706:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789131156.109124:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6756:x1876039910304896:12345-0@lo:5: Request processed in 13267us (15032us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789131156.109136:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789131156.109483:0:6756:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55b4e580 x1876039910304896/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131172 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131156.109502:0:6756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6756:1876039910304896:0@lo:5: 00000004:00080000:0.0:1789131156.109517:0:6756:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1789131157.082737:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131158.106696:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131159.130462:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131160.154636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789131160.322003:0:7073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789131161.058855:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131161.058883:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910305024:0@lo:13: 00000100:00100000:1.0:1789131161.058947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131161.059017:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305024 00000100:00100000:1.0:1789131161.059024:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305024 00000100:00100000:1.0:1789131161.059076:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131161.059087:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910305024:12345-0@lo:13: 00002000:00000024:1.0:1789131161.059123:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131161.059170:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910305024:12345-0@lo:13: Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131161.059177:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789131161.059198:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131161.059228:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a73840 x1876039910305024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131161.059261:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910305024:0@lo:13: 00000100:00100000:3.0:1789131161.061736:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131161.061755:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910305152:0@lo:400: 00000100:00100000:3.0:1789131161.061828:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131161.061888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910305280:0@lo:400: 00000100:00100000:3.0:1789131161.061914:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131161.062129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305280 00000100:00100000:3.0:1789131161.062134:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305280 00000100:00100000:3.0:1789131161.062172:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131161.062180:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910305280:12345-0@lo:400: 00000100:00100000:3.0:1789131161.062226:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910305280:12345-0@lo:400: Request processed in 47us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131161.062234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789131161.062268:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55ac70c0 x1876039910305280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131161.062282:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910305280:0@lo:400: 00000100:00100000:3.0:1789131161.062312:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910305408:0@lo:400: 00000100:00100000:3.0:1789131161.062360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131161.064444:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305408 00000100:00100000:1.0:1789131161.064454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305408 00000100:00100000:1.0:1789131161.064514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789131161.064527:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910305408:12345-0@lo:400: 00000100:00100000:1.0:1789131161.064619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910305408:12345-0@lo:400: Request processed in 96us (2257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131161.064626:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789131161.064675:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55ac4000 x1876039910305408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131177 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131161.064689:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910305408:0@lo:400: 00000100:00080000:1.0:1789131161.064716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131161.073038:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305152 00000100:00100000:2.0:1789131161.073053:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305152 00000100:00100000:2.0:1789131161.073109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789131161.073120:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3309:x1876039910305152:12345-0@lo:400: 00000100:00100000:2.0:1789131161.073219:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3309:x1876039910305152:12345-0@lo:400: Request processed in 101us (11390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131161.073227:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789131161.073548:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910305152:0@lo:400: 00000001:00080000:0.0:1789131161.137238:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1789131161.177741:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131162.202881:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131163.234277:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131164.249631:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131165.274990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131166.169448:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910305536:0@lo:13: 00000100:00100000:1.0:1789131166.169519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131166.169609:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305536 00000100:00100000:1.0:1789131166.169616:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305536 00000100:00100000:1.0:1789131166.169666:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131166.169678:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910305536:12345-0@lo:13: 00002000:00000024:1.0:1789131166.169712:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131166.169756:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910305536:12345-0@lo:13: Request processed in 82us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131166.169762:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789131166.169790:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131166.169819:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a73840 x1876039910305536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131166.169830:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789131166.169849:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910305536:0@lo:13: 00000100:00100000:3.0:1789131166.171744:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910305664:0@lo:400: 00000100:00100000:3.0:1789131166.171797:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131166.171831:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131166.171837:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910305792:0@lo:400: 00000100:00100000:3.0:1789131166.171859:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131166.171887:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305664 00000100:00100000:3.0:1789131166.171891:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305664 00000100:00100000:3.0:1789131166.171926:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789131166.171934:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3308:x1876039910305664:12345-0@lo:400: 00000100:00100000:3.0:1789131166.171980:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3308:x1876039910305664:12345-0@lo:400: Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131166.171987:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789131166.172029:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910305664:0@lo:400: 00000100:00100000:1.0:1789131166.174303:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305792 00000100:00100000:1.0:1789131166.174312:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305792 00000100:00100000:1.0:1789131166.174453:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131166.174462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910305792:12345-0@lo:400: 00000100:00100000:1.0:1789131166.174537:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910305792:12345-0@lo:400: Request processed in 76us (2676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131166.174555:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789131166.176501:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55ac4780 x1876039910305792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131166.176517:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910305792:0@lo:400: 00000100:00100000:3.0:1789131166.178198:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131166.178220:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910305920:0@lo:400: 00000100:00100000:3.0:1789131166.178283:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131166.180561:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910305920 00000100:00100000:0.0:1789131166.180639:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910305920 00000100:00100000:0.0:1789131166.180701:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131166.180711:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910305920:12345-0@lo:400: 00000100:00100000:0.0:1789131166.180795:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910305920:12345-0@lo:400: Request processed in 85us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131166.180802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789131166.180842:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789131166.181253:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55ac5680 x1876039910305920/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131166.181269:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910305920:0@lo:400: 00010000:00010000:2.0:1789131166.298474:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131167.330283:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131168.345964:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131169.369543:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131170.395898:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131171.292374:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910306048:0@lo:13: 00000100:00100000:3.0:1789131171.292462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.292557:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306048 00000100:00100000:3.0:1789131171.292574:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306048 00000100:00100000:3.0:1789131171.292630:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131171.292639:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910306048:12345-0@lo:13: 00002000:00000024:3.0:1789131171.292671:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131171.292713:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910306048:12345-0@lo:13: Request processed in 75us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131171.292720:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789131171.292739:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131171.292765:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a721c0 x1876039910306048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131171.292783:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910306048:0@lo:13: 00000100:00100000:1.0:1789131171.293007:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910306176:0@lo:400: 00000100:00100000:1.0:1789131171.293041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.293079:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131171.293085:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910306304:0@lo:400: 00000100:00100000:1.0:1789131171.293122:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.293494:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910306432:0@lo:400: 00000100:00100000:1.0:1789131171.293544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131171.293663:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306304 00000100:00100000:0.0:1789131171.293668:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306304 00000100:00100000:0.0:1789131171.293776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306432 00000100:00100000:0.0:1789131171.293780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306432 00000100:00100000:1.0:1789131171.293981:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131171.293990:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910306304:12345-0@lo:400: 00000100:00100000:1.0:1789131171.294085:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910306304:12345-0@lo:400: Request processed in 96us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.294099:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131171.294128:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131171.294146:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910306432:12345-0@lo:400: 00010000:00080000:2.0:1789131171.294148:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a73840 x1876039910306304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131171.294159:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910306304:0@lo:400: 00000100:00100000:1.0:1789131171.294196:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910306432:12345-0@lo:400: Request processed in 62us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.294202:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789131171.294207:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a721c0 x1876039910306432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131171.294217:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910306432:0@lo:400: 00000100:00100000:0.0:1789131171.296618:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306176 00000100:00100000:0.0:1789131171.296630:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306176 00000100:00100000:0.0:1789131171.296698:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789131171.296708:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3308:x1876039910306176:12345-0@lo:400: 00000100:00080000:3.0:1789131171.297918:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131171.298959:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3308:x1876039910306176:12345-0@lo:400: Request processed in 2247us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.298973:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789131171.300259:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910306176:0@lo:400: 00010000:00010000:1.0:1789131171.419553:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789131171.667051:0:7644:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789131171.667056:0:7644:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789131171.667188:0:7644:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0b41ae9800 00000020:01000004:1.0:1789131171.667204:0:7644:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789131171.667216:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789131171.667229:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c0c772b0000) 00000020:00000080:1.0:1789131171.667244:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789131171.694061:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789131171.694342:0:7644:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789131171.746121:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789131171.750474:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789131171.750522:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789131171.750581:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789131171.750606:0:7644:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789131171.750916:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789131171.750928:0:7644:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789131171.750937:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9f0de37187904345 00000020:01000004:3.0:1789131171.750944:0:7644:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789131171.750964:0:7644:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789131171.750967:0:7644:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789131171.750973:0:7644:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789131171.750992:0:7644:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789131171.750996:0:7644:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789131171.783218:0:7644:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789131171.783261:0:7644:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789131171.783265:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789131171.783266:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131171.783267:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131171.783268:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131171.783269:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131171.783271:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131171.783272:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131171.783273:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789131171.783274:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789131171.783276:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131171.783277:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131171.783280:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789131171.783282:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131171.783283:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131171.783284:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131171.783286:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131171.783286:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131171.783287:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131171.783288:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131171.783289:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789131171.783290:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789131171.783291:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131171.783292:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789131171.783361:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789131171.783381:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56848780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910306560:0@lo:253: 00000100:00100000:2.0:1789131171.783454:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.783519:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131171.783942:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306560 00000100:00100000:3.0:1789131171.783951:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306560 00000100:00100000:3.0:1789131171.784001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131171.784010:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:7644:x1876039910306560:12345-0@lo:253: 20000000:01000000:3.0:1789131171.784036:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789131171.784040:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789131171.784045:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789131171.784048:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789131171.785011:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789131171.785237:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789131171.785251:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789131171.785288:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789131171.785295:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789131171.785360:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789131171.785413:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789131171.786961:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789131171.786987:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1789131171.786989:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789131171.787023:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789131171.787030:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789131171.787092:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789131171.787100:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1789131171.787142:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789131171.787152:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789131171.787198:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789131171.787245:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789131171.791151:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1789131171.791192:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1789131171.791195:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1789131171.791233:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1789131171.791242:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789131171.791274:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1789131171.791281:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1789131171.791309:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1789131171.791318:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789131171.791725:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1789131171.792816:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1789131171.792844:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789131171.792847:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789131171.792851:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789131171.792864:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789131171.792867:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789131171.792904:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789131171.792906:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789131171.793744:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789131171.794057:0:7646:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789131171.794094:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789131171.794409:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789131171.794455:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789131171.794522:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1789131171.794538:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789131171.794540:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789131171.795163:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789131171.795212:0:7647:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789131171.795265:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789131171.795578:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789131171.795614:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789131171.795669:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1789131171.795681:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789131171.795683:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789131171.796482:0:7648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789131171.796848:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789131171.796887:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789131171.796965:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789131171.796976:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789131171.796978:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789131171.800921:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789131171.801021:0:7649:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789131171.801073:0:7649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789131171.805019:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789131171.805071:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789131171.805105:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789131171.805123:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789131171.805126:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789131171.805133:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789131171.805150:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807249:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904288 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807265:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042b2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807273:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042dc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807279:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042f8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807286:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807293:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807347:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807360:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.807385:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910306688:0@lo:104: 00000100:00100000:2.0:1789131171.807446:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.807484:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789131171.807511:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306688 00000100:00100000:2.0:1789131171.807517:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306688 00000100:00100000:2.0:1789131171.807560:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131171.807568:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c436c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910306688:12345-0@lo:104: 00010000:00010000:2.0:1789131171.807580:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807622:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131171.807628:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c436c6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910306688:12345-0@lo:104: Request processed in 60us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.807635:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789131171.807678:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131171.807685:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807692:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40031c00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131171.807697:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807705:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131171.807712:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131171.807728:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131171.807753:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807759:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131171.807775:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807781:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de37187904330 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904337 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807791:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.807792:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.807794:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131171.807810:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910306816:0@lo:103: 00000100:00100000:2.0:1789131171.807834:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.807879:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306816 00000100:00100000:2.0:1789131171.807883:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306816 00010000:00010000:2.0:1789131171.807899:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.807918:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131171.807924:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3307:x1876039910306816:12345-0@lo:103: 00010000:00010000:2.0:1789131171.807933:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131171.807938:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807946:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.807966:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131171.807993:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3307:x1876039910306816:12345-0@lo:103: Request processed in 70us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.808000:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131171.808029:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910306816:0@lo:103: 00010000:00010000:2.0:1789131171.808051:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808060:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 16 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.808068:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910306944:0@lo:104: 00000100:00100000:2.0:1789131171.808087:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.808103:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910306944 00000100:00100000:2.0:1789131171.808106:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910306944 00000100:00100000:2.0:1789131171.808126:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131171.808132:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910306944:12345-0@lo:104: 00010000:00010000:2.0:1789131171.808139:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808184:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131171.808189:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910306944:12345-0@lo:104: Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.808194:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1789131171.808216:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808234:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 16 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.808242:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307072:0@lo:104: 00000100:00100000:2.0:1789131171.808262:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.808276:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307072 00000100:00100000:2.0:1789131171.808278:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307072 00000100:00100000:2.0:1789131171.808294:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131171.808298:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910307072:12345-0@lo:104: 00010000:00010000:2.0:1789131171.808306:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808362:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789131171.808366:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910307072:12345-0@lo:104: Request processed in 68us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.808372:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789131171.808386:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131171.808390:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808396:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131171.808399:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808406:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131171.808412:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131171.808423:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131171.808442:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808448:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131171.808461:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de371879042f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ff expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808478:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131171.808481:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808487:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030e00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131171.808490:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808496:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131171.808511:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131171.808516:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789131171.808540:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808546:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131171.808557:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808563:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de371879042dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042e3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808573:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.808574:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.808576:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131171.808587:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910307200:0@lo:103: 00000100:00100000:2.0:1789131171.808612:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.808636:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131171.808646:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910307328:0@lo:103: 00000100:00100000:2.0:1789131171.808665:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.808691:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307200 00000100:00100000:2.0:1789131171.808694:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307200 00010000:00010000:2.0:1789131171.808708:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 17 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.808737:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307328 00000100:00100000:2.0:1789131171.808740:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307328 00010000:00010000:2.0:1789131171.808751:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 18 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.808762:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131171.808766:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3308:x1876039910307200:12345-0@lo:103: 00010000:00010000:2.0:1789131171.808773:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131171.808776:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 18 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808794:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 18 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808804:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131171.808829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3308:x1876039910307200:12345-0@lo:103: Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.808836:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131171.808848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131171.808854:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3308:x1876039910307328:12345-0@lo:103: 00010000:00010000:2.0:1789131171.808861:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131171.808865:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 17 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808873:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 17 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808882:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131171.808903:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3308:x1876039910307328:12345-0@lo:103: Request processed in 49us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.808908:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131171.808931:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910307328:0@lo:103: 00000100:00100000:2.0:1789131171.808939:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910307200:0@lo:103: 00010000:00010000:0.0:1789131171.808946:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.808964:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.808974:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 16 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.808991:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307456:0@lo:104: 00000100:00100000:2.0:1789131171.809006:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131171.809031:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.809040:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307456 00010000:00010000:2.0:1789131171.809040:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 16 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.809044:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307456 00000100:00100000:2.0:1789131171.809047:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307584:0@lo:104: 00000100:00100000:2.0:1789131171.809066:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.809432:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789131171.809446:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904337 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904330 expref: 16 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.809457:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910306688:0@lo:104: 00010000:00010000:2.0:1789131171.809466:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414a7c00/0x9f0de371879042ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879042f8 expref: 15 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.809474:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910306944:0@lo:104: 00010000:00010000:2.0:1789131171.809482:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fc800/0x9f0de371879042e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879042dc expref: 14 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.809491:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307072:0@lo:104: 00000100:00100000:3.0:1789131171.809658:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307584 00000100:00100000:3.0:1789131171.809663:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307584 00000100:00100000:3.0:1789131171.809683:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131171.809690:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:5839:x1876039910307456:12345-0@lo:104: 00010000:00010000:3.0:1789131171.809699:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.809751:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789131171.809756:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:5839:x1876039910307456:12345-0@lo:104: Request processed in 68us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131171.809763:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131171.809763:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307456:0@lo:104: 00000100:00100000:3.0:1789131171.809775:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131171.809781:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910307584:12345-0@lo:104: 00010000:00010000:3.0:1789131171.809788:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.809826:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789131171.809837:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5839:x1876039910307584:12345-0@lo:104: Request processed in 56us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131171.809842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131171.810515:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5839:1876039910307584:0@lo:104: 00010000:00010000:2.0:1789131171.810544:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810758:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131171.810765:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810773:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131171.810777:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810786:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131171.810792:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131171.810808:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131171.810841:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810849:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131171.810868:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810875:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de371879042b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042b9 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810886:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131171.810889:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810894:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131171.810897:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810903:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131171.810909:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131171.810914:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131171.810925:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810931:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131171.810943:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810949:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de37187904288 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790428f expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.810963:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131171.810965:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131171.810967:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131171.810980:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910307712:0@lo:103: 00000100:00100000:1.0:1789131171.811020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.811052:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131171.811058:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910307840:0@lo:103: 00000100:00100000:1.0:1789131171.811078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.811107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307712 00000100:00100000:1.0:1789131171.811112:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307712 00010000:00010000:1.0:1789131171.811132:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 14 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131171.811152:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307840 00000100:00100000:1.0:1789131171.811156:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307840 00010000:00010000:1.0:1789131171.811841:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 15 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131171.811863:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131171.811872:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3306:x1876039910307712:12345-0@lo:103: 00010000:00010000:1.0:1789131171.811884:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131171.811889:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.811912:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.811926:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8a00/0x9f0de371879042b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879042b2 expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.811939:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131171.812281:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3306:x1876039910307712:12345-0@lo:103: Request processed in 409us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.812289:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131171.812316:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131171.812338:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3306:x1876039910307840:12345-0@lo:103: 00000100:00100000:2.0:1789131171.812370:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910307712:0@lo:103: 00010000:00010000:1.0:1789131171.812523:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131171.812528:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812538:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812549:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fda00/0x9f0de3718790428f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904288 expref: 13 pid: 5837 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812561:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812569:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812583:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812596:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812602:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812608:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812614:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131171.812618:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812627:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812649:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.812660:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131171.812690:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3306:x1876039910307840:12345-0@lo:103: Request processed in 367us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.812696:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131171.812730:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910307840:0@lo:103: 00010000:00010000:0.0:1789131171.812864:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131171.814067:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.814079:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.814085:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fc600/0x9f0de3718790434c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789131171.814098:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789131171.851371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:7644:x1876039910306560:12345-0@lo:253: Request processed in 67354us (67908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.851385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789131171.851585:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56848780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910306560:0@lo:253: 10000000:01000000:2.0:1789131171.851600:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789131171.851604:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131171.851605:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131171.851607:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131171.851608:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789131171.851609:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131171.851611:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131171.851613:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131171.851614:0:7644:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789131171.851616:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131171.851617:0:7644:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789131171.851638:0:7644:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0b41ae9800 from lustre-OST0001 10000000:01000000:2.0:1789131171.851661:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789131171.851664:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789131171.851672:0:7644:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c0c492c0000 local copy 10000000:01000000:2.0:1789131171.851676:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789131171.851708:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.851734:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.851743:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.851760:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910307968:0@lo:101: 00000100:00100000:2.0:1789131171.851795:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.851853:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.851938:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910307968 00000100:00100000:0.0:1789131171.851944:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910307968 00000100:00100000:0.0:1789131171.851987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789131171.851996:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:7644:x1876039910307968:12345-0@lo:101: 00010000:00010000:0.0:1789131171.852007:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131171.852018:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031800/0x9f0de3718790435a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904353 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.852039:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031800/0x9f0de3718790435a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904353 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.852048:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031800/0x9f0de3718790435a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904353 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.852058:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031800, rc 0) 00000100:00100000:0.0:1789131171.852092:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910307968:12345-0@lo:101: Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.852098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789131171.852171:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910307968:0@lo:101: 00010000:00010000:3.0:1789131171.852184:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.852193:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.852281:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308096:0@lo:501: 00000100:00100000:3.0:1789131171.852319:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.852476:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131171.856255:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308096 00000100:00100000:1.0:1789131171.856271:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308096 00000100:00100000:1.0:1789131171.856352:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789131171.856362:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308096:12345-0@lo:501: 00000100:00100000:1.0:1789131171.856647:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308096:12345-0@lo:501: Request processed in 285us (4326us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131171.856655:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789131171.856785:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308096:0@lo:501: 10000000:01000000:3.0:1789131171.856808:0:7644:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789131171.856841:0:7644:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789131171.856849:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.856859:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.856867:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.856896:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789131171.856917:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0b41ae9800 10000000:01000000:3.0:1789131171.856922:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789131171.856932:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789131171.856935:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789131171.856939:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789131171.856942:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789131171.856965:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.856972:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.856981:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.856996:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308224:0@lo:101: 00000100:00100000:3.0:1789131171.857028:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.857065:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.857121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308224 00000100:00100000:0.0:1789131171.857126:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308224 00000100:00100000:0.0:1789131171.857160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789131171.857168:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308224:12345-0@lo:101: 00010000:00010000:0.0:1789131171.857177:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131171.857189:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904361 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.857221:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904361 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.857230:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904361 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.857238:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40030400, rc 0) 00000100:00100000:0.0:1789131171.857280:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308224:12345-0@lo:101: Request processed in 112us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.857285:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789131171.857360:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308224:0@lo:101: 00010000:00010000:3.0:1789131171.857372:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.857381:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.857441:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308352:0@lo:501: 00000100:00100000:3.0:1789131171.857466:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.857492:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.857594:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308352 00000100:00100000:0.0:1789131171.857599:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308352 00000100:00100000:0.0:1789131171.857620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789131171.857627:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308352:12345-0@lo:501: 00000100:00100000:0.0:1789131171.857791:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308352:12345-0@lo:501: Request processed in 164us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.857797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789131171.857871:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308352:0@lo:501: 00000100:00100000:3.0:1789131171.857895:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308480:0@lo:503: 00000100:00100000:3.0:1789131171.857938:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.857960:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.858015:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308480 00000100:00100000:0.0:1789131171.858019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308480 00000100:00100000:0.0:1789131171.858041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789131171.858048:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308480:12345-0@lo:503: 00000100:00100000:0.0:1789131171.858195:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308480:12345-0@lo:503: Request processed in 147us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.858203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789131171.858284:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308480:0@lo:503: 00000040:00080000:3.0:1789131171.858586:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789131171.858651:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308608:0@lo:502: 00000100:00100000:3.0:1789131171.858683:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.858702:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.858762:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308608 00000100:00100000:0.0:1789131171.858767:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308608 00000100:00100000:0.0:1789131171.858793:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789131171.858807:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308608:12345-0@lo:502: 00000100:00100000:0.0:1789131171.858947:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308608:12345-0@lo:502: Request processed in 140us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.858954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:1.0:1789131171.859038:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131171.859046:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.859054:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc600 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131171.859058:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.859067:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131171.859074:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131171.859081:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131171.859101:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.859107:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131171.859124:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.859132:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de37187904353 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x9f0de3718790435a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.859156:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131171.859157:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131171.859159:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131171.859167:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131171.859177:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910308736:0@lo:103: 00000100:00100000:1.0:1789131171.859207:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.862716:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308608:0@lo:502: 00000040:00080000:3.0:1789131171.863054:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789131171.863116:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789131171.863156:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789131171.863205:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789131171.863241:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789131171.863276:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789131171.863314:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308864:0@lo:502: 00000100:00100000:3.0:1789131171.863431:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.863467:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.863795:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308736 00000100:00100000:0.0:1789131171.863801:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308736 00000100:00100000:0.0:1789131171.863864:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131171.863873:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3309:x1876039910308736:12345-0@lo:103: 00010000:00010000:0.0:1789131171.863886:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131171.863904:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031800/0x9f0de3718790435a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904353 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.863920:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131171.863963:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3309:x1876039910308736:12345-0@lo:103: Request processed in 92us (4754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.863970:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131171.864008:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910308736:0@lo:103: 00000100:00100000:2.0:1789131171.864296:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308864 00000100:00100000:2.0:1789131171.864301:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308864 00000100:00100000:2.0:1789131171.864535:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131171.864543:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308864:12345-0@lo:502: 00000100:00100000:2.0:1789131171.864800:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308864:12345-0@lo:502: Request processed in 257us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.864807:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789131171.864838:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308864:0@lo:502: 00000040:00080000:3.0:1789131171.864965:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789131171.864978:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1789131171.865863:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789131171.865873:0:7653:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789131171.865879:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131171.865881:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789131171.865887:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131171.865901:0:7653:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c0c772b3490) 00000020:00000080:1.0:1789131171.865922:0:7653:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789131171.865927:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789131171.865981:0:7653:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0b41ae9800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789131171.865987:0:7653:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789131171.866000:0:7653:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9f0de37187904376 00010000:00010000:0.0:1789131171.872042:0:7653:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1789131171.874651:0:7653:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1789131171.878200:0:7653:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789131171.878760:0:7653:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1789131171.882963:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1789131171.883856:0:7653:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789131171.889209:0:7653:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789131171.889223:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131171.889230:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131171.889232:0:7653:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789131171.889235:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131171.889240:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131171.889241:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131171.889244:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131171.889670:0:7653:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789131171.890241:0:7653:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131171.890248:0:7653:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131171.890249:0:7653:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789131171.890254:0:7653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789131171.890440:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789131171.890467:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789131171.890482:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.890494:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131171.890512:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0b41ae9800 from 1 10000000:01000000:1.0:1789131171.890515:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131171.890547:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.890565:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.890576:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131171.890596:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308992:0@lo:101: 00000100:00100000:1.0:1789131171.890659:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.890689:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131171.890908:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910308992 00000100:00100000:2.0:1789131171.890915:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910308992 00000100:00100000:2.0:1789131171.890960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789131171.891717:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:7644:x1876039910308992:12345-0@lo:101: 00010000:00010000:2.0:1789131171.891737:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131171.891750:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790437d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.891775:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790437d expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.891786:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790437d expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.891795:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc800, rc 0) 00000100:00100000:2.0:1789131171.893215:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910308992:12345-0@lo:101: Request processed in 127us (1178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.893225:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789131171.894346:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910308992:0@lo:101: 00010000:00010000:1.0:1789131171.894378:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131171.894389:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131171.894513:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309120:0@lo:501: 00000100:00100000:1.0:1789131171.894565:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.894597:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131171.894681:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309120 00000100:00100000:2.0:1789131171.894687:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309120 00000100:00100000:2.0:1789131171.894727:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789131171.894736:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309120:12345-0@lo:501: 00000100:00100000:2.0:1789131171.894944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309120:12345-0@lo:501: Request processed in 209us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.894952:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789131171.896742:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309120:0@lo:501: 00000100:00100000:1.0:1789131171.896798:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309248:0@lo:503: 00000100:00100000:1.0:1789131171.896861:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.896904:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131171.899029:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309248 00000100:00100000:2.0:1789131171.899042:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309248 00000100:00100000:2.0:1789131171.899109:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789131171.899120:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309248:12345-0@lo:503: 00000100:00100000:2.0:1789131171.899556:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309248:12345-0@lo:503: Request processed in 437us (2694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131171.899564:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789131171.899675:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309248:0@lo:503: 00000040:00080000:2.0:1789131171.900235:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131171.900302:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309376:0@lo:502: 00000100:00100000:2.0:1789131171.900372:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.900449:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131171.903414:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309376 00000100:00100000:1.0:1789131171.903441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309376 00000100:00100000:0.0:1789131171.903581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789131171.903592:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309376:12345-0@lo:502: 00000100:00100000:0.0:1789131171.903907:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309376:12345-0@lo:502: Request processed in 317us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.903924:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789131171.903979:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309376:0@lo:502: 00000040:00080000:2.0:1789131171.904561:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789131171.904631:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789131171.904666:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309504:0@lo:502: 00000100:00100000:2.0:1789131171.904710:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.904745:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131171.904808:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309504 00000100:00100000:3.0:1789131171.904820:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309504 00000100:00100000:3.0:1789131171.904860:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789131171.904874:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309504:12345-0@lo:502: 00000100:00100000:3.0:1789131171.905059:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309504:12345-0@lo:502: Request processed in 191us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131171.905066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789131171.907699:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309504:0@lo:502: 00000040:00080000:1.0:1789131171.907925:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789131171.907941:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1789131171.908627:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131171.908635:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131171.908637:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789131171.908642:0:7657:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0b41ae9800 00000020:00000080:1.0:1789131171.908643:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131171.908653:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131171.908655:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131171.908656:0:7657:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789131171.908657:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789131171.908712:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789131171.908736:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131171.908757:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.908768:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131171.908804:0:7644:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789131171.908807:0:7644:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0b41ae9800 10000000:01000000:2.0:1789131171.908810:0:7644:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0b41ae9800 10000000:01000000:2.0:1789131171.908814:0:7644:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131171.908819:0:7644:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0b41ae9800 from 1 10000000:01000000:2.0:1789131171.908822:0:7644:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789131171.908899:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.908905:0:7644:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.908924:0:7644:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.908943:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309632:0@lo:101: 00000100:00100000:2.0:1789131171.909001:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.909094:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.909268:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309632 00000100:00100000:0.0:1789131171.909275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309632 00000100:00100000:0.0:1789131171.909512:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789131171.909523:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910309632:12345-0@lo:101: 00010000:00010000:0.0:1789131171.909535:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131171.909547:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790438b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.909569:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790438b expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.909579:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790438b expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.909587:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031800, rc 0) 00000100:00100000:0.0:1789131171.909678:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910309632:12345-0@lo:101: Request processed in 158us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.909685:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789131171.911574:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309632:0@lo:101: 00010000:00010000:2.0:1789131171.911597:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.911607:0:7644:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.911739:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309760:0@lo:501: 00000100:00100000:2.0:1789131171.911783:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.911826:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.911846:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309760 00000100:00100000:0.0:1789131171.911852:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309760 00000100:00100000:0.0:1789131171.911960:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789131171.911974:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910309760:12345-0@lo:501: 00000100:00100000:0.0:1789131171.912357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910309760:12345-0@lo:501: Request processed in 353us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.912364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789131171.912480:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309760:0@lo:501: 00000100:00100000:1.0:1789131171.912524:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309888:0@lo:503: 00000100:00100000:1.0:1789131171.912576:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131171.912608:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.912667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910309888 00000100:00100000:0.0:1789131171.912671:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910309888 00000100:00100000:0.0:1789131171.912781:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789131171.912796:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910309888:12345-0@lo:503: 00000100:00100000:0.0:1789131171.913001:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910309888:12345-0@lo:503: Request processed in 214us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.913008:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789131171.913037:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910309888:0@lo:503: 00000040:00080000:3.0:1789131171.913367:0:7644:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789131171.913423:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310016:0@lo:502: 00000100:00100000:3.0:1789131171.913860:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.913901:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131171.914017:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310016 00000100:00100000:1.0:1789131171.914023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310016 00000100:00100000:1.0:1789131171.914062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789131171.914069:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910310016:12345-0@lo:502: 00000100:00100000:1.0:1789131171.914383:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910310016:12345-0@lo:502: Request processed in 314us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131171.914391:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789131171.916638:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310016:0@lo:502: 00000040:00080000:3.0:1789131171.917032:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789131171.917562:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789131171.917591:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789131171.917633:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789131171.917662:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789131171.917712:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789131171.917743:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789131171.918015:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789131171.918220:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789131171.918262:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789131171.918297:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789131171.919122:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789131171.919251:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789131171.919293:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789131171.919463:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789131171.919574:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789131171.919611:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789131171.919661:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789131171.919696:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789131171.919729:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789131171.919811:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789131171.919851:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789131171.919884:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789131171.919931:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789131171.919964:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789131171.920072:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789131171.920128:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789131171.920228:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1789131171.920269:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789131171.920316:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1789131171.920474:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1789131171.920522:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1789131171.920557:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1789131171.920604:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1789131171.920636:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1789131171.920678:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1789131171.920731:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1789131171.920777:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310144:0@lo:502: 00000100:00100000:3.0:1789131171.920852:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.920943:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.920995:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310144 00000100:00100000:0.0:1789131171.921065:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310144 00000100:00100000:0.0:1789131171.921424:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789131171.921437:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910310144:12345-0@lo:502: 00000100:00100000:0.0:1789131171.921741:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910310144:12345-0@lo:502: Request processed in 306us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.921748:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789131171.921817:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310144:0@lo:502: 00000040:00080000:3.0:1789131171.922137:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789131171.922151:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789131171.923100:0:7658:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789131171.923117:0:7658:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c0c43724ed8) 00000020:00000080:0.0:1789131171.923138:0:7658:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789131171.923311:0:7658:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0b41ae9800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789131171.923316:0:7658:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0b41ae9800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789131171.923318:0:7658:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0b41ae9800 3 00010000:00080000:0.0:1789131171.923430:0:7658:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0b4270b800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1789131171.925232:0:7658:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789131171.925567:0:7658:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789131171.925599:0:7658:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789131171.925610:0:7658:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9f0de371879043a0 00000100:00080000:0.0:1789131171.925620:0:7658:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789131171.925625:0:7658:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0b4270b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131171.925654:0:7658:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c55b4e1c0 x1876039910310272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131171.925681:0:7658:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789131171.925882:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910310272:0@lo:38: 00000100:00100000:2.0:1789131171.925948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789131171.926240:0:7658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1789131171.926411:0:7659:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9c0c55a73840 x1876039910310400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131171.926420:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d480 going to sleep for 0 seconds 00000020:01000000:3.0:1789131171.927923:0:7644:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789131171.927956:0:7644:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789131171.927974:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.927985:0:7644:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789131171.928051:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789131171.928054:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789131171.928056:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789131171.928057:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789131171.928058:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789131171.928060:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789131171.928061:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789131171.928063:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789131171.928064:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789131171.928066:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789131171.928067:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789131171.928071:0:7644:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789131171.928073:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789131171.928074:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789131171.928075:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789131171.928076:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789131171.928077:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789131171.928078:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789131171.928079:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789131171.928080:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789131171.928081:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789131171.928082:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789131171.928083:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789131171.928104:0:7644:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789131171.928118:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310528:0@lo:253: 00000100:00100000:3.0:1789131171.928173:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.928206:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131171.929539:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310528 00000100:00100000:1.0:1789131171.929550:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310528 00000100:00100000:1.0:1789131171.929600:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789131171.929609:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7644:x1876039910310528:12345-0@lo:253: 20000000:01000000:1.0:1789131171.929642:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789131171.929660:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789131171.929756:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310272 00000100:00100000:0.0:1789131171.929761:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310272 00000100:00100000:0.0:1789131171.929793:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131171.929800:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910310272:12345-0@lo:38: 00010000:00080000:0.0:1789131171.929818:0:5846:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:0.0:1789131171.929851:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9f0de371879043a7 00000004:00100000:0.0:1789131171.929865:0:5846:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789131171.929894:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9c0b42709000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131171.929957:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876039910310272:12345-0@lo:38: Request processed in 156us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.929964:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789131171.930017:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55b4e1c0 x1876039910310272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131171.930027:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131171.930034:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789131171.930041:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789131171.930046:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789131171.930048:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789131171.930054:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000847f5201): req@ffff9c0c55a73840 x1876039910310400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131171.930068:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910310272:0@lo:38: 00000100:00100000:2.0:1789131171.930207:0:7659:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131171.930236:0:7659:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.933145:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310400 00000100:00100000:0.0:1789131171.933158:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310400 00000100:00100000:0.0:1789131171.933227:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131171.933236:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1876039910310400:12345-0@lo:901: 00000100:00100000:0.0:1789131171.933633:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7659:x1876039910310400:12345-0@lo:901: Request processed in 396us (3424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.933645:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789131171.933716:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131171.934919:0:7659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c55a73840 x1876039910310400/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789131187 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131171.934950:0:7659:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7659:1876039910310400:0@lo:901: 20000000:01000000:2.0:1789131171.974650:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789131171.974672:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789131171.977718:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789131171.977727:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789131171.977752:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.977769:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042ea expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.977798:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.977836:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131171.977851:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 14 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131171.977865:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac7840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910310656:0@lo:104: 00000100:00100000:3.0:1789131171.977928:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131171.977989:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131171.978116:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310656 00000100:00100000:0.0:1789131171.978123:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310656 00000100:00100000:0.0:1789131171.978186:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131171.978194:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910310656:12345-0@lo:104: 00010000:00010000:0.0:1789131171.978207:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978264:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131171.978270:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5860:x1876039910310656:12345-0@lo:104: Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.978277:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789131171.978298:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131171.978309:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978316:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131171.978339:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978349:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131171.978357:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131171.978362:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789131171.978391:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978410:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131171.978429:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978436:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6c00/0x9f0de371879042ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042f1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978454:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131171.978456:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131171.978458:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131171.978476:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910310784:0@lo:103: 00000100:00100000:0.0:1789131171.978522:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131171.978561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310784 00000100:00100000:0.0:1789131171.978565:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310784 00010000:00010000:0.0:1789131171.978597:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131171.978618:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131171.978624:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3309:x1876039910310784:12345-0@lo:103: 00010000:00010000:0.0:1789131171.978634:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131171.978639:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978650:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 15 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978664:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978682:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789131171.978695:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001151393s 00010000:00010000:0.0:1789131171.978699:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978706:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978713:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978719:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978724:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b9800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131171.978728:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978734:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978743:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131171.978751:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131171.978780:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3309:x1876039910310784:12345-0@lo:103: Request processed in 156us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.978786:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131171.978852:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910310784:0@lo:103: 00010000:00010000:2.0:1789131171.979481:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8000/0x9f0de371879042f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879042ea expref: 14 pid: 5838 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131171.979493:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac7840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1876039910310656:0@lo:104: 00010000:00010000:2.0:1789131171.979518:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.979527:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.979533:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131171.979539:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b9800/0x9f0de371879043ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131171.984364:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:7644:x1876039910310528:12345-0@lo:253: Request processed in 54746us (56180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131171.984379:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789131171.984746:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:42008966-81eb-4eb4-8558-cee0fff8e6d5:7644:1876039910310528:0@lo:253: 10000000:01000000:3.0:1789131171.984760:0:7644:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789131171.984764:0:7644:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789131171.984765:0:7644:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789131171.984767:0:7644:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789131171.984768:0:7644:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789131171.984769:0:7644:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789131171.984771:0:7644:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789131171.984772:0:7644:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789131171.984774:0:7644:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789131171.984775:0:7644:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789131171.984777:0:7644:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789131171.984779:0:7644:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789131171.984795:0:7644:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789131172.002561:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131172.002821:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131172.004165:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131172.004718:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131172.005670:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131172.005883:0:7644:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789131172.006874:0:7644:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789131172.271522:0:7644:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789131172.271531:0:7644:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789131172.271564:0:7644:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789131172.271626:0:7644:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789131172.271639:0:7644:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789131172.271667:0:7644:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789131172.441749:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131173.473706:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131174.493855:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131175.513608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131176.412004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910310912:0@lo:13: 00000100:00100000:0.0:1789131176.412073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131176.412156:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910310912 00000100:00100000:0.0:1789131176.412163:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910310912 00000100:00100000:0.0:1789131176.412213:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131176.412223:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910310912:12345-0@lo:13: 00002000:00000024:0.0:1789131176.412259:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131176.412300:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910310912:12345-0@lo:13: Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131176.412308:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789131176.412343:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789131176.412371:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4e1c0 x1876039910310912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131192 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131176.412525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910310912:0@lo:13: 00010000:00010000:3.0:1789131176.537524:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131177.433970:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910311424:0@lo:400: 00000100:00100000:0.0:1789131177.434040:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.434101:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789131177.434108:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910311040:0@lo:400: 00000100:00100000:0.0:1789131177.434136:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.434158:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910311552:0@lo:400: 00000100:00100000:0.0:1789131177.434182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.434223:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910311168:0@lo:400: 00000100:00100000:0.0:1789131177.434247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.434266:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131177.434271:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910311296:0@lo:400: 00000100:00100000:0.0:1789131177.434307:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.434358:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311424 00000100:00100000:0.0:1789131177.434364:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311424 00000100:00100000:0.0:1789131177.434414:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131177.434423:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910311424:12345-0@lo:400: 00000100:00100000:0.0:1789131177.434482:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910311424:12345-0@lo:400: Request processed in 60us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.434488:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131177.434509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311040 00000100:00100000:0.0:1789131177.434512:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311040 00000100:00100000:0.0:1789131177.434532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789131177.434538:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3306:x1876039910311040:12345-0@lo:400: 00000100:00100000:0.0:1789131177.434564:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3306:x1876039910311040:12345-0@lo:400: Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.434570:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789131177.434594:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311552 00000100:00100000:0.0:1789131177.434597:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311552 00000100:00100000:0.0:1789131177.434620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311168 00000100:00100000:0.0:1789131177.434623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311168 00000100:00100000:0.0:1789131177.434634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311296 00000100:00100000:0.0:1789131177.434636:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311296 00000100:00100000:0.0:1789131177.434648:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131177.434653:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910311552:12345-0@lo:400: 00000100:00100000:0.0:1789131177.434681:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910311552:12345-0@lo:400: Request processed in 28us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.434693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131177.434705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131177.434710:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910311168:12345-0@lo:400: 00000100:00100000:0.0:1789131177.434740:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910311168:12345-0@lo:400: Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.434745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131177.434754:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789131177.434759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910311296:12345-0@lo:400: 00000100:00100000:0.0:1789131177.434780:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910311296:12345-0@lo:400: Request processed in 21us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.434786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789131177.434803:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789131177.434828:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4d2c0 x1876039910311296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131177.434841:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910311296:0@lo:400: 00010000:00080000:0.0:1789131177.434851:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4fc00 x1876039910311168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131177.434859:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910311168:0@lo:400: 00000100:00100000:0.0:1789131177.434886:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910311040:0@lo:400: 00010000:00080000:0.0:1789131177.434895:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4f480 x1876039910311552/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131177.434904:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910311552:0@lo:400: 00010000:00080000:0.0:1789131177.434913:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4c000 x1876039910311424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131177.434927:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910311424:0@lo:400: 00010000:00010000:3.0:1789131177.563688:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789131177.946592:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789131177.946599:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43172800 from 30 10000000:01000000:0.0:1789131177.946605:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131177.946657:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.946674:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.946686:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131177.946710:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311680:0@lo:101: 00000100:00100000:0.0:1789131177.947482:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.947539:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131177.947577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311680 00000100:00100000:0.0:1789131177.947584:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311680 00000100:00100000:0.0:1789131177.947627:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789131177.947636:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910311680:12345-0@lo:101: 00010000:00010000:0.0:1789131177.947650:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131177.947663:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879043b5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.947689:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879043b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.947700:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043b5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.947720:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40030e00, rc 0) 00000100:00100000:0.0:1789131177.947762:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910311680:12345-0@lo:101: Request processed in 126us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.947770:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789131177.952503:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311680:0@lo:101: 00010000:00010000:0.0:1789131177.952530:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.952543:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131177.952620:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311808:0@lo:501: 00000100:00100000:0.0:1789131177.952678:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.952726:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.952891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311808 00000100:00100000:2.0:1789131177.952898:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311808 00000100:00100000:2.0:1789131177.952945:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789131177.952964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910311808:12345-0@lo:501: 00000100:00100000:2.0:1789131177.953348:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910311808:12345-0@lo:501: Request processed in 385us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.953356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789131177.956940:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311808:0@lo:501: 00000100:00100000:3.0:1789131177.957028:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311936:0@lo:503: 00000100:00100000:3.0:1789131177.957101:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.957143:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131177.957151:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910311936 00000100:00100000:0.0:1789131177.957158:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910311936 00000100:00100000:0.0:1789131177.957288:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789131177.957562:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910311936:12345-0@lo:503: 00000100:00100000:0.0:1789131177.958563:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910311936:12345-0@lo:503: Request processed in 1263us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.958572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789131177.958989:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910311936:0@lo:503: 00000100:00100000:2.0:1789131177.963471:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7934:1876039910312064:0@lo:502: 00000100:00100000:2.0:1789131177.963567:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.963609:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42d58b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131177.964671:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312064 00000100:00100000:0.0:1789131177.964682:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312064 00000100:00100000:0.0:1789131177.965473:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789131177.965485:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7934:x1876039910312064:12345-0@lo:502: 00000100:00100000:0.0:1789131177.965855:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7934:x1876039910312064:12345-0@lo:502: Request processed in 372us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.965872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789131177.974562:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7934:1876039910312064:0@lo:502: 00000100:00100000:3.0:1789131177.974678:0:7934:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7934:1876039910312192:0@lo:502: 00000100:00100000:3.0:1789131177.974758:0:7934:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.974961:0:7934:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.975048:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312192 00000100:00100000:2.0:1789131177.975055:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312192 00000100:00100000:2.0:1789131177.975107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789131177.975117:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7934:x1876039910312192:12345-0@lo:502: 00000100:00100000:3.0:1789131177.976197:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:7934:x1876039910312192:12345-0@lo:502: Request processed in 1076us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131177.976219:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789131177.976549:0:7934:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7934:1876039910312192:0@lo:502: 00000040:00080000:2.0:1789131177.976585:0:7934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789131177.977065:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789131177.977086:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789131177.977097:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131177.977123:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131177.977134:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789131177.977137:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789131177.977140:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789131177.977274:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131177.977284:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131177.977293:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131177.977313:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312320:0@lo:101: 00000100:00100000:3.0:1789131177.977583:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.977665:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c49464600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.977754:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312320 00000100:00100000:2.0:1789131177.977760:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312320 00000100:00100000:2.0:1789131177.978004:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789131177.978014:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910312320:12345-0@lo:101: 00010000:00010000:2.0:1789131177.978026:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131177.978039:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879043c3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.978061:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879043c3 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.978070:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043c3 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.978078:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fd200, rc 0) 00000100:00100000:2.0:1789131177.978120:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312320:12345-0@lo:101: Request processed in 108us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.978127:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789131177.978194:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312320:0@lo:101: 00010000:00010000:0.0:1789131177.978208:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131177.978216:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131177.978263:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312448:0@lo:501: 00000100:00100000:0.0:1789131177.978291:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131177.978385:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45f7c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.978443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312448 00000100:00100000:2.0:1789131177.978448:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312448 00000100:00100000:2.0:1789131177.978496:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789131177.978502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312448:12345-0@lo:501: 00000100:00100000:2.0:1789131177.978746:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312448:12345-0@lo:501: Request processed in 244us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.978753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789131177.978800:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312448:0@lo:501: 00000100:00100000:2.0:1789131177.979183:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312576:0@lo:503: 00000100:00100000:2.0:1789131177.979234:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.979250:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.979263:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312576 00000100:00100000:2.0:1789131177.979266:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312576 00000100:00100000:2.0:1789131177.979286:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789131177.979291:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312576:12345-0@lo:503: 00000100:00100000:2.0:1789131177.979900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312576:12345-0@lo:503: Request processed in 605us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.979907:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789131177.979952:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312576:0@lo:503: 00000100:00100000:2.0:1789131177.980120:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7935:1876039910312704:0@lo:502: 00000100:00100000:2.0:1789131177.980155:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.980175:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312704 00000100:00100000:2.0:1789131177.980178:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312704 00000100:00100000:2.0:1789131177.980197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789131177.980304:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:7935:x1876039910312704:12345-0@lo:502: 00000100:00100000:2.0:1789131177.980728:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:7935:x1876039910312704:12345-0@lo:502: Request processed in 427us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.980745:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789131177.981024:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.981040:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7935:1876039910312704:0@lo:502: 00000020:01000000:2.0:1789131177.981064:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131177.981072:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131177.981075:0:7935:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131177.981080:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131177.981082:0:7935:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789131177.981101:0:7935:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7935:1876039910312832:0@lo:502: 00000100:00100000:2.0:1789131177.981134:0:7935:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.981161:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312832 00000100:00100000:2.0:1789131177.981177:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312832 00000100:00100000:2.0:1789131177.981197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789131177.981271:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:7935:x1876039910312832:12345-0@lo:502: 00000100:00100000:2.0:1789131177.981585:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:7935:x1876039910312832:12345-0@lo:502: Request processed in 380us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.981592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789131177.981622:0:7935:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42dcc780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.981636:0:7935:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7935:1876039910312832:0@lo:502: 00000020:01000000:2.0:1789131177.981713:0:7935:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131177.981718:0:7935:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131177.981720:0:7935:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789131177.981724:0:7935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1789131177.982023:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1789131177.982042:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789131177.982051:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982072:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131177.982082:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789131177.982085:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43124000 from 30 10000000:01000000:2.0:1789131177.982088:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789131177.982111:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982119:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982128:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131177.982141:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312960:0@lo:101: 00000100:00100000:2.0:1789131177.982467:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.982485:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4597b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131177.982500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910312960 00000100:00100000:2.0:1789131177.982504:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910312960 00000100:00100000:2.0:1789131177.982532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789131177.982539:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910312960:12345-0@lo:101: 00010000:00010000:2.0:1789131177.982548:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131177.982558:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879043d1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982578:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879043d1 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982598:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043d1 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.982606:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fda00, rc 0) 00000100:00100000:2.0:1789131177.982635:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910312960:12345-0@lo:101: Request processed in 97us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131177.982641:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789131177.983131:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910312960:0@lo:101: 00010000:00010000:2.0:1789131177.983146:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131177.983154:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131177.983484:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313088:0@lo:501: 00000100:00100000:2.0:1789131177.983512:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131177.983563:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4597b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131177.983597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313088 00000100:00100000:3.0:1789131177.983601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313088 00000100:00100000:3.0:1789131177.984044:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789131177.984054:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910313088:12345-0@lo:501: 00000100:00100000:3.0:1789131177.986117:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910313088:12345-0@lo:501: Request processed in 2059us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131177.986127:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789131177.989516:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313088:0@lo:501: 00000100:00100000:3.0:1789131177.989577:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313216:0@lo:503: 00000100:00100000:3.0:1789131177.989657:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.989696:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131177.991097:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313216 00000100:00100000:3.0:1789131177.991107:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313216 00000100:00100000:3.0:1789131177.991156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789131177.991176:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910313216:12345-0@lo:503: 00000100:00100000:3.0:1789131177.992042:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910313216:12345-0@lo:503: Request processed in 876us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131177.992052:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789131177.992113:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313216:0@lo:503: 00000100:00100000:3.0:1789131177.995604:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7936:1876039910313344:0@lo:502: 00000100:00100000:3.0:1789131177.995689:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.995753:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313344 00000100:00100000:3.0:1789131177.995759:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313344 00000100:00100000:3.0:1789131177.996037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789131177.996046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:7936:x1876039910313344:12345-0@lo:502: 00000100:00100000:3.0:1789131177.996438:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:7936:x1876039910313344:12345-0@lo:502: Request processed in 393us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131177.996446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789131177.996507:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131177.997309:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7936:1876039910313344:0@lo:502: 00000100:00100000:3.0:1789131177.997389:0:7936:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7936:1876039910313472:0@lo:502: 00000100:00100000:3.0:1789131177.997430:0:7936:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131177.997448:0:7936:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c3ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131177.997979:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313472 00000100:00100000:0.0:1789131177.997985:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313472 00000100:00100000:0.0:1789131177.998032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789131177.998041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:7936:x1876039910313472:12345-0@lo:502: 00000100:00100000:0.0:1789131177.998273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:7936:x1876039910313472:12345-0@lo:502: Request processed in 233us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131177.998282:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789131178.003869:0:7936:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7936:1876039910313472:0@lo:502: 00000040:00080000:2.0:1789131178.003919:0:7936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789131178.004240:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789131178.004269:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789131178.004295:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004306:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131178.004317:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789131178.004319:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43124000 from 5 10000000:01000000:3.0:1789131178.004350:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789131178.004385:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004391:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004400:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131178.004418:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313600:0@lo:101: 00000100:00100000:3.0:1789131178.004486:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131178.004523:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494643c0 going to sleep for 10 seconds 00000100:00100000:3.0:1789131178.004539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313600 00000100:00100000:3.0:1789131178.004544:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313600 00000100:00100000:3.0:1789131178.004592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789131178.004601:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910313600:12345-0@lo:101: 00010000:00010000:3.0:1789131178.004615:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131178.004626:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b9000/0x9f0de371879043e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879043df expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004649:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b9000/0x9f0de371879043e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879043df expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004666:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b9000/0x9f0de371879043e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043df expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.004676:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b9000, rc 0) 00000100:00100000:3.0:1789131178.004719:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910313600:12345-0@lo:101: Request processed in 119us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131178.004726:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789131178.004787:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313600:0@lo:101: 00010000:00010000:0.0:1789131178.004799:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131178.004808:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131178.004869:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313728:0@lo:256: 00000100:00100000:0.0:1789131178.004909:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131178.004929:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131178.005039:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313728 00000100:00100000:2.0:1789131178.005044:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313728 00000100:00100000:2.0:1789131178.005067:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789131178.005074:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910313728:12345-0@lo:256: 20000000:01000000:2.0:1789131178.005088:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789131178.005104:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789131178.005107:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789131178.005208:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910313728:12345-0@lo:256: Request processed in 125us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131178.005216:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789131178.005248:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313728:0@lo:256: 10000000:01000000:2.0:1789131178.005286:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131178.005292:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.005299:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131178.005307:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789131178.005309:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789131178.005311:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789131178.005354:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.005362:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.005370:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131178.005382:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313856:0@lo:101: 00000100:00100000:2.0:1789131178.005408:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.005429:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494643c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131178.005569:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313856 00000100:00100000:3.0:1789131178.005573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313856 00000100:00100000:3.0:1789131178.005603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789131178.005610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910313856:12345-0@lo:101: 00010000:00010000:3.0:1789131178.005616:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131178.005624:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879043ed expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.005638:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.005646:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131178.005652:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8400, rc 0) 00000100:00100000:3.0:1789131178.005677:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910313856:12345-0@lo:101: Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131178.005682:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789131178.005974:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313856:0@lo:101: 00010000:00010000:2.0:1789131178.005985:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.006003:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131178.006045:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313984:0@lo:501: 00000100:00100000:2.0:1789131178.006070:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.006097:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494643c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131178.006109:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910313984 00000100:00100000:2.0:1789131178.006113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910313984 00000100:00100000:2.0:1789131178.006141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789131178.006148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910313984:12345-0@lo:501: 00000100:00100000:2.0:1789131178.006551:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910313984:12345-0@lo:501: Request processed in 402us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131178.006558:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789131178.007189:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910313984:0@lo:501: 00000100:00100000:0.0:1789131178.007223:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e91680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910314112:0@lo:503: 00000100:00100000:0.0:1789131178.007265:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131178.007295:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131178.007521:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314112 00000100:00100000:3.0:1789131178.007527:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314112 00000100:00100000:3.0:1789131178.007555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789131178.007569:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910314112:12345-0@lo:503: 00000100:00100000:3.0:1789131178.008123:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910314112:12345-0@lo:503: Request processed in 554us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131178.008131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789131178.008160:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e91680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910314112:0@lo:503: 00000100:00100000:2.0:1789131178.014398:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7937:1876039910314240:0@lo:502: 00000100:00100000:2.0:1789131178.014493:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.014542:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42d58c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131178.014601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314240 00000100:00100000:0.0:1789131178.014608:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314240 00000100:00100000:0.0:1789131178.014655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789131178.014664:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:7937:x1876039910314240:12345-0@lo:502: 00000100:00100000:0.0:1789131178.014987:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:7937:x1876039910314240:12345-0@lo:502: Request processed in 322us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131178.014996:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789131178.015158:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7937:1876039910314240:0@lo:502: 00000020:01000000:2.0:1789131178.015187:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131178.015195:0:7937:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789131178.015874:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131178.015878:0:7937:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789131178.015887:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131178.015891:0:7937:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1789131178.015914:0:7937:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789131178.015916:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131178.015940:0:7937:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c0b41cf4ed8) 00000020:00000080:2.0:1789131178.015968:0:7937:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1789131178.015975:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131178.016046:0:7937:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789131178.016051:0:7937:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789131178.016066:0:7937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de37187904402 00010000:00080000:2.0:1789131178.016095:0:7937:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0b41cff000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1789131178.020637:0:7937:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1789131178.021014:0:7937:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789131178.021029:0:7937:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789131178.021573:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131178.021778:0:7937:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131178.021829:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789131178.021892:0:7937:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789131178.028558:0:7940:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131178.028568:0:7940:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789131178.031198:0:7937:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131178.031280:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789131178.031318:0:7937:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789131178.031357:0:7937:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187904409 00000100:00080000:2.0:1789131178.031367:0:7937:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131178.031373:0:7937:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0b41cff000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1789131178.031406:0:7937:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c5684ad00 x1876039910314368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131178.031430:0:7937:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789131178.031487:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131178.031492:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131178.031493:0:7937:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789131178.031496:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131178.031500:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131178.031502:0:7937:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131178.031504:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131178.031507:0:7937:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789131178.031532:0:7937:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7937:1876039910314496:0@lo:502: 00000100:00100000:2.0:1789131178.031615:0:7937:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.031660:0:7937:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789131178.031737:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910314368:0@lo:8: 00000100:00100000:1.0:1789131178.031772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.032030:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910314752:0@lo:400: 00000100:00100000:1.0:1789131178.032058:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.032079:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131178.032085:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910314624:0@lo:400: 00000100:00100000:1.0:1789131178.032107:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.032131:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910314880:0@lo:400: 00000100:00100000:1.0:1789131178.032153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.032625:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131178.032632:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910315008:0@lo:400: 00000100:00100000:1.0:1789131178.032662:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.032696:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314752 00000100:00100000:1.0:1789131178.032701:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314752 00000100:00100000:1.0:1789131178.032736:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314624 00000100:00100000:1.0:1789131178.032739:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314624 00000100:00100000:1.0:1789131178.032750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315008 00000100:00100000:1.0:1789131178.032752:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315008 00000100:00100000:1.0:1789131178.032765:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131178.032773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910314752:12345-0@lo:400: 00000100:00100000:1.0:1789131178.032835:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910314752:12345-0@lo:400: Request processed in 62us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.032842:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131178.032860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131178.032867:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910314624:12345-0@lo:400: 00000100:00100000:1.0:1789131178.032908:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910314624:12345-0@lo:400: Request processed in 42us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.032915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131178.032927:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131178.032933:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910315008:12345-0@lo:400: 00000100:00100000:1.0:1789131178.032975:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910315008:12345-0@lo:400: Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.032981:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131178.033005:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314368 00000100:00100000:1.0:1789131178.033009:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314368 00000100:00100000:1.0:1789131178.033027:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314880 00000100:00100000:1.0:1789131178.033030:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314880 00000100:00100000:1.0:1789131178.033054:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131178.033060:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910314880:12345-0@lo:400: 00000100:00100000:1.0:1789131178.033099:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910314880:12345-0@lo:400: Request processed in 36us (942us total) trans 0 rc 0/0 00010000:00080000:0.0:1789131178.033099:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a3840 x1876039910315008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.033118:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131178.033133:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131178.033134:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910315008:0@lo:400: 00000100:00100000:1.0:1789131178.033142:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876039910314368:12345-0@lo:8: 00010000:00080000:0.0:1789131178.033152:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a0b40 x1876039910314880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131178.033162:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910314880:0@lo:400: 00010000:00080000:1.0:1789131178.033177:0:6705:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1789131178.033222:0:6705:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187904410 00002000:00100000:1.0:1789131178.033237:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c0c7a5b6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789131178.033241:0:6705:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789131178.033244:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789131178.033390:0:6705:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789131178.033549:0:6705:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789131178.033579:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a5b2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131178.033620:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876039910314368:12345-0@lo:8: Request processed in 479us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.033626:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789131178.033651:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131178.033674:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684ad00 x1876039910314368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131188 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.033683:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131178.033689:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789131178.033696:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789131178.033700:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789131178.033703:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cff000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789131178.033716:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789131178.033720:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910314368:0@lo:8: 00010000:00080000:1.0:1789131178.033748:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a3480 x1876039910314624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.033757:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910314624:0@lo:400: 00010000:00080000:1.0:1789131178.033767:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a1e00 x1876039910314752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.033774:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910314752:0@lo:400: 00000004:00080000:0.0:1789131178.034087:0:7940:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789131178.034476:0:7940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 190008152849ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789131178.034514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910314496 00000100:00100000:3.0:1789131178.034520:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910314496 00000100:00100000:3.0:1789131178.034558:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789131178.034565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:7937:x1876039910314496:12345-0@lo:502: 00000100:00100000:3.0:1789131178.034766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:7937:x1876039910314496:12345-0@lo:502: Request processed in 201us (3150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131178.034773:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789131178.035211:0:7937:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:7937:1876039910314496:0@lo:502: 00000020:01000000:2.0:1789131178.035242:0:7937:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131178.035249:0:7937:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131178.035252:0:7937:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789131178.035257:0:7937:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1789131178.035663:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1789131178.035681:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789131178.035690:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035700:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131178.035709:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789131178.035712:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c0c492c0000 from 1 10000000:01000000:2.0:1789131178.035714:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789131178.035741:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035749:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035757:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131178.035774:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910315136:0@lo:101: 00000100:00100000:2.0:1789131178.035811:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.035849:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789131178.035874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315136 00000100:00100000:2.0:1789131178.035878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315136 00000100:00100000:2.0:1789131178.035907:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789131178.035914:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910315136:12345-0@lo:101: 00010000:00010000:2.0:1789131178.035923:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131178.035934:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904417 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035953:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904417 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035963:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904417 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.035971:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceac00, rc 0) 00000100:00100000:2.0:1789131178.036000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910315136:12345-0@lo:101: Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131178.036006:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789131178.036304:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910315136:0@lo:101: 00010000:00010000:2.0:1789131178.036316:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.036339:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131178.036473:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910315264:0@lo:501: 00000100:00100000:2.0:1789131178.036500:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131178.036514:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789131178.036532:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315264 00000100:00100000:2.0:1789131178.036535:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315264 00000100:00100000:2.0:1789131178.036555:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789131178.036561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910315264:12345-0@lo:501: 00000100:00100000:2.0:1789131178.036761:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910315264:12345-0@lo:501: Request processed in 199us (259us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789131178.036769:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789131178.036799:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910315264:0@lo:501: 10000000:01000000:2.0:1789131178.036820:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789131178.036825:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131178.036843:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131178.167785:0:7941:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789131178.167837:0:7941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315520:0@lo:7: 00000100:00100000:1.0:1789131178.167935:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.168002:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910315392:0@lo:13: 00000100:00100000:1.0:1789131178.168033:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.168140:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315520 00000100:00100000:1.0:1789131178.168147:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315520 00000100:00100000:1.0:1789131178.168205:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131178.168214:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7941:x1876039910315520:12345-0@lo:7: 00000100:00100000:2.0:1789131178.170839:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315392 00000100:00100000:2.0:1789131178.170854:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315392 00000100:00100000:2.0:1789131178.170926:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131178.170937:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876039910315392:12345-0@lo:13: 00002000:00000024:2.0:1789131178.170976:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1789131178.171076:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1876039910315392:12345-0@lo:13: Request processed in 141us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131178.171085:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1789131178.172181:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131178.172214:0:7941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1cc0 going to sleep for 11 seconds 00010000:00080000:1.0:1789131178.175730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a1e00 x1876039910315392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.175766:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910315392:0@lo:13: 00002000:00080000:1.0:1789131178.189353:0:6705:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1789131178.189365:0:6705:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789131178.190765:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7941:x1876039910315520:12345-0@lo:7: Request processed in 22536us (22818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.190783:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789131178.190881:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a3480 x1876039910315520/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789131194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.190900:0:7941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315520:0@lo:7: 00000004:00080000:1.0:1789131178.190919:0:7941:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789131178.190975:0:7941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315648:0@lo:5: 00000100:00100000:1.0:1789131178.191028:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.191080:0:7941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131178.191103:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315648 00000100:00100000:1.0:1789131178.191111:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315648 00000100:00100000:1.0:1789131178.191158:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131178.191168:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7941:x1876039910315648:12345-0@lo:5: 00002000:00080000:1.0:1789131178.191201:0:6704:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789131178.191206:0:6704:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789131178.192206:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7941:x1876039910315648:12345-0@lo:5: Request processed in 1034us (1172us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789131178.192237:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789131178.193088:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a3480 x1876039910315648/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131178.193111:0:7941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315648:0@lo:5: 00000004:00080000:1.0:1789131178.193131:0:7941:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789131178.193184:0:7941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315776:0@lo:700: 00000100:00100000:1.0:1789131178.193237:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.193494:0:7941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131178.193524:0:6713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315776 00000100:00100000:1.0:1789131178.193532:0:6713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315776 00000100:00100000:1.0:1789131178.193661:0:6713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131178.193674:0:6713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7941:x1876039910315776:12345-0@lo:700: 00000100:00100000:1.0:1789131178.193724:0:6713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a2580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1876039910315904:0@lo:700: 00000100:00100000:1.0:1789131178.193771:0:6713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.193795:0:6713:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131178.195163:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910315904 00000100:00100000:1.0:1789131178.195178:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910315904 00000100:00100000:1.0:1789131178.198242:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131178.200896:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1876039910315904:12345-0@lo:700: 00000004:00080000:2.0:1789131178.300941:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1789131178.412154:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789131178.445621:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6713:x1876039910315904:12345-0@lo:700: Request processed in 247360us (251843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.445637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789131178.445916:0:6713:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a2580 x1876039910315904/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789131194 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131178.445952:0:6713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a2580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6713:1876039910315904:0@lo:700: 40000000:02000000:2.0:1789131178.445966:0:6713:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1789131178.586405:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789131178.610564:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1789131178.610582:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789131178.620668:0:6713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7941:x1876039910315776:12345-0@lo:700: Request processed in 426988us (427422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131178.620684:0:6713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789131178.628053:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a12c0 x1876039910315776/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789131194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131178.628076:0:7941:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789131178.628095:0:7941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910315776:0@lo:700: 00000004:02000040:1.0:1789131178.717751:0:7941:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1789131178.731409:0:7941:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910316032:0@lo:5: 00000100:00100000:1.0:1789131178.731488:0:7941:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131178.731541:0:7941:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c494640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131178.731915:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316032 00000100:00100000:1.0:1789131178.731924:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316032 00000100:00100000:1.0:1789131178.731980:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131178.731989:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7941:x1876039910316032:12345-0@lo:5: 00002000:00080000:1.0:1789131178.740066:0:6704:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789131178.740086:0:6704:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789131178.745143:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7941:x1876039910316032:12345-0@lo:5: Request processed in 13148us (13649us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789131178.745157:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789131178.745559:0:7941:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a3840 x1876039910316032/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789131194 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131178.745673:0:7941:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a3840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7941:1876039910316032:0@lo:5: 00000004:00080000:3.0:1789131178.745689:0:7941:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789131179.613999:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131179.835210:0:8008:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789131180.638563:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131181.530153:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131181.530179:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910316160:0@lo:13: 00000100:00100000:3.0:1789131181.530247:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131181.530364:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316160 00000100:00100000:2.0:1789131181.530372:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316160 00000100:00100000:2.0:1789131181.530445:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131181.530456:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910316160:12345-0@lo:13: 00002000:00000024:2.0:1789131181.530487:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131181.530529:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910316160:12345-0@lo:13: Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131181.530536:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789131181.530574:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c56848f00 x1876039910316160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131181.530590:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56848f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910316160:0@lo:13: 00000100:00080000:3.0:1789131181.530655:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789131181.661400:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131182.681713:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131183.065837:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910316544:0@lo:400: 00000100:00100000:2.0:1789131183.065908:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131183.065963:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131183.065969:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910316672:0@lo:400: 00000100:00100000:2.0:1789131183.065997:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131183.066230:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910316288:0@lo:400: 00000100:00100000:1.0:1789131183.066277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131183.066305:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910316800:0@lo:400: 00000100:00100000:1.0:1789131183.066370:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131183.066392:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789131183.066398:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910316416:0@lo:400: 00000100:00100000:1.0:1789131183.066419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131183.066450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910316928:0@lo:400: 00000100:00100000:1.0:1789131183.066471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131183.066504:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316544 00000100:00100000:1.0:1789131183.066521:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316544 00000100:00100000:1.0:1789131183.066573:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316800 00000100:00100000:1.0:1789131183.066577:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316800 00000100:00100000:1.0:1789131183.066590:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316416 00000100:00100000:1.0:1789131183.066593:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316416 00000100:00100000:1.0:1789131183.066606:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131183.066613:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910316544:12345-0@lo:400: 00000100:00100000:1.0:1789131183.066667:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910316544:12345-0@lo:400: Request processed in 54us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131183.066676:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131183.066692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789131183.066898:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789131183.066908:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:3.0:1789131183.066923:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131183.067158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789131183.067167:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910316416:12345-0@lo:400: 00000100:00100000:3.0:1789131183.067209:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910316416:12345-0@lo:400: Request processed in 44us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131183.067222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131183.067660:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316288 00000100:00100000:2.0:1789131183.067666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316288 00000100:00100000:2.0:1789131183.067711:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789131183.067719:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910316288:12345-0@lo:400: 00000100:00100000:2.0:1789131183.067764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910316288:12345-0@lo:400: Request processed in 46us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131183.067770:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789131183.067900:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910316800:12345-0@lo:400: 00000100:00100000:1.0:1789131183.067938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910316800:12345-0@lo:400: Request processed in 1239us (1567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131183.067943:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131183.067965:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316672 00000100:00100000:1.0:1789131183.067969:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316672 00000100:00100000:1.0:1789131183.068007:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910316928 00000100:00100000:1.0:1789131183.068011:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910316928 00000100:00100000:1.0:1789131183.068026:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131183.068032:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910316672:12345-0@lo:400: 00000100:00100000:1.0:1789131183.068064:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910316672:12345-0@lo:400: Request processed in 33us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131183.068071:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131183.068082:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789131183.068088:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910316928:12345-0@lo:400: 00000100:00100000:1.0:1789131183.068113:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910316928:12345-0@lo:400: Request processed in 26us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131183.068118:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789131183.068169:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684ad00 x1876039910316672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131183.068182:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910316672:0@lo:400: 00010000:00080000:1.0:1789131183.068195:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c56849e00 x1876039910316544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131183.068204:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910316544:0@lo:400: 00010000:00080000:1.0:1789131183.068239:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684b840 x1876039910316416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131183.068249:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910316416:0@lo:400: 00010000:00080000:1.0:1789131183.068259:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c568483c0 x1876039910316928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131183.068267:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c568483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910316928:0@lo:400: 00000100:00100000:1.0:1789131183.068276:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910316288:0@lo:400: 00010000:00080000:1.0:1789131183.068286:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684b0c0 x1876039910316800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131183.068294:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910316800:0@lo:400: 00000100:00080000:2.0:1789131183.068603:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131183.068608:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131183.586740:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131183.586763:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317056:0@lo:13: 00000100:00100000:3.0:1789131183.586830:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131183.587303:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317056 00000100:00100000:3.0:1789131183.587312:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317056 00000100:00100000:3.0:1789131183.587375:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131183.587384:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910317056:12345-0@lo:13: 00002000:00000024:3.0:1789131183.587416:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131183.587476:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910317056:12345-0@lo:13: Request processed in 93us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131183.587484:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789131183.587525:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55ac5680 x1876039910317056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131183.587546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317056:0@lo:13: 00000001:00080000:1.0:1789131183.673842:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1789131183.705789:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131184.730474:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131185.753567:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131186.437023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131186.437147:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893516672 00000100:00100000:0.0:1789131186.437156:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893516672 00000100:00100000:0.0:1789131186.437209:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:0.0:1789131186.437218:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1876039893516672:12345-192.168.203.52@tcp:250: 00010000:00080000:0.0:1789131186.437246:0:5839:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 41196d9a-43e4-4d8b-a4ec-306ec0de1dfc@192.168.203.52@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:0.0:1789131186.437273:0:5839:0:(genops.c:1385:class_connect()) connect: client 41196d9a-43e4-4d8b-a4ec-306ec0de1dfc, cookie 0x9f0de37187904425 00000100:00080000:0.0:1789131186.437459:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9c0b42709800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131186.437535:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+5:2351:x1876039893516672:12345-192.168.203.52@tcp:250: Request processed in 316us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131186.437544:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1789131186.455107:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131186.455411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893516544 00000100:00100000:0.0:1789131186.455421:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893516544 00000100:00100000:0.0:1789131186.455474:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1789131186.455484:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+5:5578:x1876039893516544:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1789131186.455499:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131186.455516:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0394b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131186.455543:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131186.455565:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131186.455587:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031200, rc 0) 00000100:00100000:0.0:1789131186.455647:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+6:5578:x1876039893516544:12345-192.168.203.52@tcp:101: Request processed in 163us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131186.455654:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1789131186.468881:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.469041:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893516800 00000100:00100000:2.0:1789131186.469051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893516800 00000100:00100000:2.0:1789131186.469108:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:2.0:1789131186.469128:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+6:5578:x1876039893516800:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1789131186.469557:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+6:5578:x1876039893516800:12345-192.168.203.52@tcp:501: Request processed in 430us (684us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789131186.469566:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1789131186.471880:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.472024:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893516928 00000100:00100000:2.0:1789131186.472033:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893516928 00000100:00100000:2.0:1789131186.472086:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1789131186.472095:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+6:5578:x1876039893516928:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1789131186.472121:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131186.472139:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0394be expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.472178:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.472189:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.472197:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceae00, rc 0) 00000100:00100000:2.0:1789131186.472441:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+7:5578:x1876039893516928:12345-192.168.203.52@tcp:101: Request processed in 345us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.472452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1789131186.478737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131186.478889:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517056 00000100:00100000:0.0:1789131186.478899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517056 00000100:00100000:0.0:1789131186.478954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1789131186.478964:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+7:5578:x1876039893517056:12345-192.168.203.52@tcp:501: 00000100:00100000:0.0:1789131186.479454:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5578:x1876039893517056:12345-192.168.203.52@tcp:501: Request processed in 489us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131186.479463:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1789131186.482869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131186.483013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517184 00000100:00100000:0.0:1789131186.483022:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517184 00000100:00100000:0.0:1789131186.483075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:0.0:1789131186.483084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5578:x1876039893517184:12345-192.168.203.52@tcp:503: 00000100:00100000:0.0:1789131186.483839:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5578:x1876039893517184:12345-192.168.203.52@tcp:503: Request processed in 752us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131186.483850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1789131186.496837:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.497365:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517312 00000100:00100000:2.0:1789131186.497376:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517312 00000100:00100000:2.0:1789131186.497438:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1789131186.497449:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5597:x1876039893517312:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1789131186.497797:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5597:x1876039893517312:12345-192.168.203.52@tcp:502: Request processed in 348us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.497805:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1789131186.568997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131186.569394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517440 00000100:00100000:0.0:1789131186.569416:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517440 00000100:00100000:0.0:1789131186.569479:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1789131186.569490:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5597:x1876039893517440:12345-192.168.203.52@tcp:502: 00000100:00100000:0.0:1789131186.569858:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5597:x1876039893517440:12345-192.168.203.52@tcp:502: Request processed in 369us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131186.569876:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1789131186.578082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131186.578233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517568 00000100:00100000:3.0:1789131186.578243:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517568 00000100:00100000:3.0:1789131186.578430:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1789131186.578456:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5578:x1876039893517568:12345-192.168.203.52@tcp:101: 00010000:00010000:3.0:1789131186.578473:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131186.578489:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8000/0x9f0de3718790443a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0394e8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131186.578516:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8000/0x9f0de3718790443a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394e8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131186.578528:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8000/0x9f0de3718790443a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394e8 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131186.578536:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8000, rc 0) 00000100:00100000:3.0:1789131186.578725:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5578:x1876039893517568:12345-192.168.203.52@tcp:101: Request processed in 271us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131186.578734:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1789131186.593779:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.593890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517696 00000100:00100000:2.0:1789131186.593901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517696 00000100:00100000:2.0:1789131186.593953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1789131186.593964:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5578:x1876039893517696:12345-192.168.203.52@tcp:256: 20000000:01000000:2.0:1789131186.593990:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789131186.594013:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789131186.594017:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789131186.594020:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789131186.594022:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789131186.596594:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5578:x1876039893517696:12345-192.168.203.52@tcp:256: Request processed in 2620us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.596608:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:0.0:1789131186.601863:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.601969:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517824 00000100:00100000:2.0:1789131186.601980:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517824 00000100:00100000:2.0:1789131186.602041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1789131186.602051:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5578:x1876039893517824:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1789131186.602067:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131186.602100:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0394ef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.606106:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.606127:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131186.606138:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceaa00, rc 0) 00000100:00100000:2.0:1789131186.606315:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5578:x1876039893517824:12345-192.168.203.52@tcp:101: Request processed in 4263us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.606341:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:3.0:1789131186.610094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.610190:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893517952 00000100:00100000:2.0:1789131186.610392:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893517952 00000100:00100000:2.0:1789131186.610461:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1789131186.610472:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5578:x1876039893517952:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1789131186.611615:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5578:x1876039893517952:12345-192.168.203.52@tcp:501: Request processed in 1138us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.611627:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:1.0:1789131186.614506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.615024:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518080 00000100:00100000:2.0:1789131186.615033:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518080 00000100:00100000:2.0:1789131186.615107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1789131186.615116:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5578:x1876039893518080:12345-192.168.203.52@tcp:503: 00000100:00100000:2.0:1789131186.615540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5578:x1876039893518080:12345-192.168.203.52@tcp:503: Request processed in 423us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.615548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:0.0:1789131186.619774:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.619873:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518208 00000100:00100000:2.0:1789131186.619881:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518208 00000100:00100000:2.0:1789131186.619970:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:2.0:1789131186.619981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5603:x1876039893518208:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1789131186.620437:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5603:x1876039893518208:12345-192.168.203.52@tcp:502: Request processed in 457us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.620446:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1789131186.623822:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131186.623908:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518336 00000100:00100000:2.0:1789131186.623916:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518336 00000100:00100000:2.0:1789131186.623991:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:2.0:1789131186.624000:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5603:x1876039893518336:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1789131186.624431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5603:x1876039893518336:12345-192.168.203.52@tcp:502: Request processed in 430us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.624440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1789131186.629312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131186.630093:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518464 00000100:00100000:3.0:1789131186.630106:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518464 00000100:00100000:2.0:1789131186.630463:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131186.630472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1876039893518464:12345-192.168.203.52@tcp:38: 00010000:00080000:2.0:1789131186.630503:0:5844:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:2.0:1789131186.630548:0:5844:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de37187904448 00000004:00100000:2.0:1789131186.630579:0:5844:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789131186.630585:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1789131186.650055:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317184:0@lo:13: 00000100:00100000:3.0:1789131186.650128:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131186.650469:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317184 00000100:00100000:3.0:1789131186.650477:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317184 00000100:00100000:3.0:1789131186.650530:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131186.650539:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910317184:12345-0@lo:13: 00002000:00000024:3.0:1789131186.650574:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131186.650618:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910317184:12345-0@lo:13: Request processed in 80us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131186.650638:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1789131186.650792:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131186.650850:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403ed00 x1876039910317184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131202 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131186.650868:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317184:0@lo:13: 00000100:00080000:2.0:1789131186.661406:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cf8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131186.661489:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893518464:12345-192.168.203.52@tcp:38: Request processed in 31015us (32186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131186.661501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00010000:00010000:2.0:1789131186.779564:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131187.664434:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131187.664482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131187.664667:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518592 00000100:00100000:2.0:1789131187.664679:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518592 00000100:00080000:3.0:1789131187.664747:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131187.664759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518720 00000100:00100000:2.0:1789131187.664764:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518720 00000100:00100000:2.0:1789131187.664792:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131187.664802:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1789131187.664804:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:0:x1876039893518592:12345-192.168.203.52@tcp:41: 00000100:00100000:0.0:1789131187.664820:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5314d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:5578:x1876039893518720:12345-192.168.203.52@tcp:41: 00000004:00000024:2.0:1789131187.664850:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:0.0:1789131187.664851:0:8131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789131187.664918:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:0:x1876039893518592:12345-192.168.203.52@tcp:41: Request processed in 117us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131187.664927:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131187.665472:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5314d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5578:x1876039893518720:12345-192.168.203.52@tcp:41: Request processed in 657us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131187.665481:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1789131187.674538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131187.674642:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518848 00000100:00100000:3.0:1789131187.674652:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518848 00000100:00100000:3.0:1789131187.674738:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1789131187.674749:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5578:x1876039893518848:12345-192.168.203.52@tcp:40: 00000100:00100000:3.0:1789131187.674839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5578:x1876039893518848:12345-192.168.203.52@tcp:40: Request processed in 92us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131187.674847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131187.679802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131187.680032:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131187.680076:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131187.680142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519232 00000100:00100000:2.0:1789131187.680152:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519232 00000100:00100000:2.0:1789131187.680210:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:2.0:1789131187.680221:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893519232:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1789131187.680292:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893519232:12345-192.168.203.52@tcp:400: Request processed in 73us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131187.680300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:0.0:1789131187.681300:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131187.681431:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519360 00000100:00100000:3.0:1789131187.681439:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519360 00000100:00100000:3.0:1789131187.681484:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1789131187.681494:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5578:x1876039893519360:12345-192.168.203.52@tcp:33: 00000100:00100000:1.0:1789131187.683651:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893518976 00000100:00100000:1.0:1789131187.683663:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893518976 00000100:00100000:2.0:1789131187.689982:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519104 00000100:00100000:2.0:1789131187.689997:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519104 00000100:00100000:2.0:1789131187.690123:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1789131187.690132:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876039893518976:12345-192.168.203.52@tcp:8: 00010000:00080000:2.0:1789131187.690165:0:6706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1789131187.690200:0:6706:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de3718790444f 00002000:00100000:2.0:1789131187.690212:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 17aefd58-d436-480c-8fa4-256f2e59c9d4/ffff9c0b41cfd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131187.690222:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789131187.692722:0:6706:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789131187.692919:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cfb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131187.692999:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893518976:12345-192.168.203.52@tcp:8: Request processed in 2866us (13205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131187.693010:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1789131187.693045:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1789131187.693051:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876039893519104:12345-192.168.203.52@tcp:8: 00010000:00080000:2.0:1789131187.693076:0:6706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1789131187.693569:0:6706:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de37187904456 00002000:00100000:2.0:1789131187.693655:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17aefd58-d436-480c-8fa4-256f2e59c9d4/ffff9c0c81e74000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131187.693679:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789131187.695995:0:6706:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789131187.696044:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e71000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131187.697303:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893519104:12345-192.168.203.52@tcp:8: Request processed in 4243us (17218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131187.697318:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000004:00080000:0.0:1789131187.713435:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31880us 00000004:00200000:1.0:1789131187.743764:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1789131187.743940:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5578:x1876039893519360:12345-192.168.203.52@tcp:33: Request processed in 62443us (62639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131187.743972:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00010000:00010000:3.0:1789131187.804155:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131187.973838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131187.986058:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519488 00000100:00100000:3.0:1789131187.986074:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519488 00000100:00100000:3.0:1789131187.986166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1789131187.986177:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5620:x1876039893519488:12345-192.168.203.52@tcp:101: 00010000:00010000:3.0:1789131187.986196:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131187.986270:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b9800/0x9f0de3718790445d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039519 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986372:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986385:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986410:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131187.986785:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789131187.986790:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131187.986878:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986908:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b9800/0x9f0de3718790445d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039519 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986926:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039519 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131187.986935:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131187.986938:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131187.986942:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8a00, rc 0) 00000100:00100000:3.0:1789131187.987048:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:5620:x1876039893519488:12345-192.168.203.52@tcp:101: Request processed in 873us (13232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131187.987057:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1789131188.185658:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317696:0@lo:400: 00000100:00100000:0.0:1789131188.185658:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910317440:0@lo:400: 00000100:00100000:1.0:1789131188.185795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910317312:0@lo:400: 00000100:00100000:2.0:1789131188.185854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910317568:0@lo:400: 00000100:00100000:0.0:1789131188.192514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131188.192572:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910317952:0@lo:400: 00000100:00100000:0.0:1789131188.193144:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131188.193212:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317952 00000100:00100000:0.0:1789131188.193219:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317952 00000100:00080000:0.0:1789131188.193243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131188.193279:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131188.194113:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910317952:12345-0@lo:400: 00000100:00100000:0.0:1789131188.194196:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910317952:12345-0@lo:400: Request processed in 908us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131188.194205:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789131188.194251:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c6580 x1876039910317952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131188.194261:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789131188.194277:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910317952:0@lo:400: 00000100:00100000:1.0:1789131188.194412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131188.194453:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910317824:0@lo:400: 00000100:00100000:1.0:1789131188.194494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131188.194555:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317312 00000100:00100000:1.0:1789131188.194560:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317312 00000100:00100000:1.0:1789131188.194606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789131188.194614:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910317312:12345-0@lo:400: 00000100:00100000:1.0:1789131188.194651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910317312:12345-0@lo:400: Request processed in 38us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131188.194658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789131188.194688:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317440 00000100:00100000:1.0:1789131188.194691:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317440 00000100:00100000:1.0:1789131188.194713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317824 00000100:00100000:1.0:1789131188.194715:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317824 00000100:00100000:1.0:1789131188.194736:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131188.194742:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910317440:12345-0@lo:400: 00000100:00100000:1.0:1789131188.194772:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910317440:12345-0@lo:400: Request processed in 30us (2265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131188.194778:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131188.194788:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131188.194794:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910317824:12345-0@lo:400: 00000100:00100000:1.0:1789131188.194815:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910317824:12345-0@lo:400: Request processed in 22us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131188.194832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131188.194872:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910317312:0@lo:400: 00000100:00100000:1.0:1789131188.194884:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910317824:0@lo:400: 00000100:00080000:1.0:1789131188.194915:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131188.195448:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910317440:0@lo:400: 00000100:00100000:2.0:1789131188.201068:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131188.201154:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317568 00000100:00100000:1.0:1789131188.201163:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317568 00000100:00100000:1.0:1789131188.201239:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131188.201250:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910317568:12345-0@lo:400: 00000100:00100000:1.0:1789131188.201319:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910317568:12345-0@lo:400: Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131188.201351:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789131188.201360:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131188.201415:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910317696 00000100:00100000:1.0:1789131188.201419:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910317696 00000100:00100000:1.0:1789131188.201461:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131188.201469:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910317696:12345-0@lo:400: 00000100:00100000:2.0:1789131188.201502:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910317568:0@lo:400: 00000100:00100000:1.0:1789131188.201509:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910317696:12345-0@lo:400: Request processed in 40us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131188.201516:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789131188.201697:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c4780 x1876039910317696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131188.201709:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910317696:0@lo:400: 00000100:00080000:0.0:1789131188.201936:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131188.201941:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131188.699062:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910318080:0@lo:13: 00000100:00100000:2.0:1789131188.699138:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131188.699339:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318080 00000100:00100000:3.0:1789131188.699347:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318080 00000100:00100000:3.0:1789131188.699418:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131188.699428:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910318080:12345-0@lo:13: 00002000:00000024:3.0:1789131188.699452:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131188.699506:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910318080:12345-0@lo:13: Request processed in 80us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131188.699513:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789131188.700661:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c4780 x1876039910318080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131188.700686:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910318080:0@lo:13: 00010000:00010000:2.0:1789131188.827985:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131189.849514:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131190.114601:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131190.114795:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519616 00000100:00100000:3.0:1789131190.114805:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519616 00000100:00100000:3.0:1789131190.115037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1789131190.115052:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c568483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:5673:x1876039893519616:12345-192.168.203.52@tcp:41: 00000004:00000024:3.0:1789131190.115094:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789131190.115173:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c568483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:5673:x1876039893519616:12345-192.168.203.52@tcp:41: Request processed in 126us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131190.115180:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:0.0:1789131190.115507:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131190.121153:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131190.121274:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519744 00000100:00100000:3.0:1789131190.121288:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519744 00000100:00080000:0.0:1789131190.121556:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131190.121665:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131190.121684:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5673:x1876039893519744:12345-192.168.203.52@tcp:13: 00002000:00000024:3.0:1789131190.121741:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131190.122889:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5673:x1876039893519744:12345-192.168.203.52@tcp:13: Request processed in 1204us (1742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131190.122919:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131190.132535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131190.132808:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893519872 00000100:00100000:1.0:1789131190.132820:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893519872 00000100:00080000:0.0:1789131190.133032:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131190.133970:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131190.133991:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5673:x1876039893519872:12345-192.168.203.52@tcp:13: 00002000:00000024:1.0:1789131190.134043:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131190.134140:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:5673:x1876039893519872:12345-192.168.203.52@tcp:13: Request processed in 158us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131190.134170:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000001:00100000:1.0:1789131190.812672:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00010000:00010000:2.0:1789131190.873819:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131191.772267:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131191.772292:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910318208:0@lo:13: 00000100:00100000:2.0:1789131191.772382:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131191.772597:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318208 00000100:00100000:3.0:1789131191.772606:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318208 00000100:00100000:3.0:1789131191.772672:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131191.772688:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910318208:12345-0@lo:13: 00002000:00000024:3.0:1789131191.772712:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131191.772758:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910318208:12345-0@lo:13: Request processed in 77us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131191.772765:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789131191.772807:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131191.772835:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403cf00 x1876039910318208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131191.772854:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910318208:0@lo:13: 00000001:00100000:2.0:1789131191.847647:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000001:00100000:0.0:1789131191.858284:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00010000:00010000:3.0:1789131191.897996:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131192.923506:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131192.934991:0:8317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789131193.100941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131193.100987:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131193.101020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131193.101033:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520000 00000100:00100000:0.0:1789131193.101043:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520000 00000100:00100000:1.0:1789131193.101045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131193.101065:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520128 00000100:00100000:1.0:1789131193.101068:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520128 00000100:00100000:0.0:1789131193.101091:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:0.0:1789131193.101100:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893520000:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1789131193.101104:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1789131193.101109:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893520128:12345-192.168.203.52@tcp:400: 00000100:00100000:1.0:1789131193.102204:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893520128:12345-192.168.203.52@tcp:400: Request processed in 1087us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131193.102217:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1789131193.102259:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520256 00000100:00100000:1.0:1789131193.102265:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520256 00000100:00100000:1.0:1789131193.102301:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520384 00000100:00100000:1.0:1789131193.102305:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520384 00000100:00100000:1.0:1789131193.102337:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1789131193.102345:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893520256:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1789131193.102471:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789131193.102480:0:6705:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789131193.102588:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1789131193.102596:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893520384:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1789131193.103785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893520000:12345-192.168.203.52@tcp:400: Request processed in 2676us (2842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131193.103797:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1789131193.110131:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893520384:12345-192.168.203.52@tcp:400: Request processed in 7510us (9058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131193.110147:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1789131193.115902:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893520256:12345-192.168.203.52@tcp:400: Request processed in 13544us (14901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131193.115918:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:1.0:1789131193.115964:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131193.115970:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131193.115973:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131193.306225:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910318720:0@lo:400: 00000100:00100000:1.0:1789131193.306303:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131193.306409:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131193.306415:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910318592:0@lo:400: 00000100:00100000:1.0:1789131193.306441:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131193.306473:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318592 00000100:00100000:1.0:1789131193.306480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318592 00000100:00100000:1.0:1789131193.306535:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131193.306544:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910318592:12345-0@lo:400: 00000100:00100000:1.0:1789131193.306594:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910318592:12345-0@lo:400: Request processed in 51us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131193.306601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789131193.306603:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910318464:0@lo:400: 00000100:00080000:1.0:1789131193.306622:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131193.306633:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131193.306652:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910318592:0@lo:400: 00000100:00100000:0.0:1789131193.306652:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910318976:0@lo:400: 00000100:00100000:1.0:1789131193.306672:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318464 00000100:00100000:1.0:1789131193.306675:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318464 00000100:00100000:0.0:1789131193.306685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131193.306697:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131193.306704:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910318464:12345-0@lo:400: 00000100:00100000:0.0:1789131193.306719:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789131193.306725:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910318336:0@lo:400: 00000100:00100000:1.0:1789131193.306734:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910318464:12345-0@lo:400: Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131193.306740:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789131193.306749:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131193.306766:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318336 00000100:00100000:1.0:1789131193.306769:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318336 00000100:00100000:0.0:1789131193.306770:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910318848:0@lo:400: 00000100:00100000:2.0:1789131193.306955:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318720 00000100:00100000:2.0:1789131193.306960:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318720 00000100:00100000:0.0:1789131193.306974:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131193.306996:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318976 00000100:00100000:0.0:1789131193.306996:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910318464:0@lo:400: 00000100:00100000:2.0:1789131193.306998:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318976 00000100:00100000:2.0:1789131193.307018:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131193.307024:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910318720:12345-0@lo:400: 00000100:00080000:0.0:1789131193.307027:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131193.307029:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131193.307036:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910318848 00000100:00100000:0.0:1789131193.307039:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910318848 00000100:00100000:2.0:1789131193.307062:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910318720:12345-0@lo:400: Request processed in 39us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131193.307063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789131193.307068:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910318848:12345-0@lo:400: 00000100:00100000:2.0:1789131193.307069:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131193.307081:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131193.307086:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910318976:12345-0@lo:400: 00000100:00100000:0.0:1789131193.307099:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910318848:12345-0@lo:400: Request processed in 31us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131193.307106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131193.307109:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910318976:12345-0@lo:400: Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00080000:0.0:1789131193.307119:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131193.307121:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131193.307133:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910318848:0@lo:400: 00010000:00080000:0.0:1789131193.307144:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbe580 x1876039910318976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131193.307154:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910318976:0@lo:400: 00010000:00080000:0.0:1789131193.307181:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbc780 x1876039910318720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131193.307190:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910318720:0@lo:400: 00000100:00100000:1.0:1789131193.308013:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789131193.308030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910318336:12345-0@lo:400: 00000100:00100000:1.0:1789131193.308082:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910318336:12345-0@lo:400: Request processed in 59us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131193.308089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789131193.309298:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910318336:0@lo:400: 00000100:00100000:0.0:1789131193.826857:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131193.826885:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910319104:0@lo:13: 00000100:00100000:0.0:1789131193.826960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131193.829337:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910319104 00000100:00100000:3.0:1789131193.829358:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910319104 00000100:00100000:3.0:1789131193.829417:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131193.829427:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910319104:12345-0@lo:13: 00002000:00000024:3.0:1789131193.829464:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131193.829543:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910319104:12345-0@lo:13: Request processed in 116us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131193.829551:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789131193.829600:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c4f00 x1876039910319104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131193.829622:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910319104:0@lo:13: 00010000:00010000:1.0:1789131193.949006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131194.969921:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131195.993544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131196.890089:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131196.890112:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910319232:0@lo:13: 00000100:00100000:0.0:1789131196.890194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131196.890263:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910319232 00000100:00100000:0.0:1789131196.890271:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910319232 00000100:00100000:0.0:1789131196.890346:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789131196.890356:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910319232:12345-0@lo:13: 00002000:00000024:0.0:1789131196.890387:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131196.890433:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910319232:12345-0@lo:13: Request processed in 79us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.890439:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1789131196.890468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789131196.890504:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e92580 x1876039910319232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131196.890522:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910319232:0@lo:13: 00000020:00000080:3.0:1789131196.951787:0:8468:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff9805810 20000000:00000080:3.0:1789131196.951806:0:8468:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0b41383800 uarg=0000000000000000 20000000:01000000:3.0:1789131196.951843:0:8468:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789131196.951845:0:8468:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789131196.951848:0:8468:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789131196.951853:0:8468:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789131196.951857:0:8468:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789131196.951873:0:8468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789131196.951876:0:8468:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789131196.952055:0:8468:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789131196.952058:0:8468:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789131196.953700:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1789131196.954730:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1789131196.954873:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1789131196.954911:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1789131196.954925:0:8468:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789131196.954927:0:8468:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789131196.955729:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789131196.955991:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789131196.956016:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789131196.956041:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789131196.956050:0:8468:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789131196.956051:0:8468:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789131196.957113:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789131196.957744:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789131196.957821:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789131196.957856:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789131196.957868:0:8468:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789131196.957871:0:8468:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789131196.959229:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789131196.959857:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789131196.959940:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789131196.959977:0:8468:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1789131196.959991:0:8468:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789131196.960008:0:8468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960024:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904361 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960032:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790438b expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960039:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043b5 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960045:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043c3 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960051:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043d1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960068:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960075:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904417 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960084:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960092:0:8468:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960099:0:8468:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960188:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.960205:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 9 pid: 5839 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.960221:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319360:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131196.961053:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961064:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961075:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319488:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131196.961118:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961136:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 18 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961146:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319616:0@lo:104: 00000100:00100000:1.0:1789131196.961180:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131196.961215:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961223:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961231:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319744:0@lo:104: 00000100:00100000:1.0:1789131196.961264:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131196.961297:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789131196.961309:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910319616 00000100:00100000:1.0:1789131196.961315:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910319616 00000100:00100000:1.0:1789131196.961373:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910319744 00000100:00100000:1.0:1789131196.961376:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910319744 00000100:00100000:1.0:1789131196.961390:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131196.961399:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:8468:x1876039910319616:12345-0@lo:104: 00010000:00010000:1.0:1789131196.961422:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961468:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131196.961474:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:8468:x1876039910319616:12345-0@lo:104: Request processed in 77us (295us total) trans 0 rc 0/0 00010000:00010000:3.0:1789131196.961489:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789131196.961491:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789131196.961496:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961503:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc1b0bc20) 00000100:00100000:1.0:1789131196.961506:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 10000000:00010000:3.0:1789131196.961507:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961516:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961522:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a641050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910319744:12345-0@lo:104: 10000000:00010000:3.0:1789131196.961523:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131196.961529:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131196.961530:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961562:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1789131196.961563:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961567:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a641050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910319744:12345-0@lo:104: Request processed in 56us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131196.961574:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789131196.961579:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131196.961594:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961599:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebe00/0x9f0de37187904417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790441e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961609:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131196.961611:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131196.961612:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.961613:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961614:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.961619:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebc00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131196.961622:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961629:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.961636:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.961641:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131196.961655:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961660:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789131196.961661:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789131196.961671:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.961674:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910319872:0@lo:103: 00010000:00010000:1.0:1789131196.961677:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cebc00/0x9f0de371879043ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043f4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961686:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.961688:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.961690:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131196.961703:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131196.961710:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961719:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 18 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.961741:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320128:0@lo:104: 00000100:00100000:1.0:1789131196.961772:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131196.961772:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910320000:0@lo:103: 00000100:00100000:1.0:1789131196.961792:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320128 00000100:00100000:0.0:1789131196.961793:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131196.961796:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320128 00000100:00100000:1.0:1789131196.961817:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131196.961825:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320128:12345-0@lo:104: 00010000:00010000:1.0:1789131196.961833:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961867:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131196.961872:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320128:12345-0@lo:104: Request processed in 50us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131196.961878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789131196.961892:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131196.961896:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.961904:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910319872 00000100:00100000:3.0:1789131196.961909:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910319872 00010000:00010000:1.0:1789131196.961917:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc600 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131196.961920:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961927:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961930:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.961933:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.961938:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789131196.961949:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320000 00000100:00100000:3.0:1789131196.961952:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320000 00010000:00010000:1.0:1789131196.961955:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961960:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131196.961961:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 20 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.961972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789131196.961974:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.961978:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3307:x1876039910319872:12345-0@lo:103: 00010000:00010000:1.0:1789131196.961980:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc600/0x9f0de371879043d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043d8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.961987:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131196.961990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.961991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131196.961992:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 20 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.961993:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131196.961999:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789131196.962000:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 20 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962007:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910320256:0@lo:103: 00010000:00010000:3.0:1789131196.962013:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131196.962029:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131196.962042:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3307:x1876039910319872:12345-0@lo:103: Request processed in 65us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131196.962049:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789131196.962055:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.962061:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320256 00000100:00100000:3.0:1789131196.962064:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320256 00010000:00010000:1.0:1789131196.962073:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962082:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320384:0@lo:104: 00000100:00100000:1.0:1789131196.962105:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131196.962124:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320384 00000100:00100000:1.0:1789131196.962128:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320384 00000100:00100000:1.0:1789131196.962145:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789131196.962146:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131196.962150:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320384:12345-0@lo:104: 00000100:00100000:0.0:1789131196.962153:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3307:x1876039910320000:12345-0@lo:103: 00010000:00010000:1.0:1789131196.962157:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.962160:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131196.962187:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131196.962192:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320384:12345-0@lo:104: Request processed in 42us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131196.962197:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789131196.962210:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131196.962213:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962219:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b8c00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131196.962223:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962229:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.962235:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.962246:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131196.962261:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962267:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131196.962276:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962282:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8c00/0x9f0de371879043c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962289:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962291:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962292:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131196.962302:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910320512:0@lo:103: 00000100:00100000:1.0:1789131196.962363:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131196.962395:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962404:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 20 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962412:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320640:0@lo:104: 00000100:00100000:1.0:1789131196.962434:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789131196.962434:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 20 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.962443:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 20 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962451:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320640 00010000:00010000:0.0:1789131196.962452:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131196.962454:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320640 00000100:00100000:1.0:1789131196.962469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131196.962474:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320640:12345-0@lo:104: 00000100:00100000:0.0:1789131196.962474:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3307:x1876039910320000:12345-0@lo:103: Request processed in 322us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.962481:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1789131196.962489:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.962491:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320512 00000100:00100000:0.0:1789131196.962493:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320512 00010000:00010000:0.0:1789131196.962505:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.962517:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789131196.962518:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131196.962523:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320640:12345-0@lo:104: Request processed in 48us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.962523:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910320512:12345-0@lo:103: 00000100:00100000:1.0:1789131196.962529:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789131196.962529:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131196.962533:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.962540:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962541:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131196.962545:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962550:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030800 already unused, calling callback (ffffffffc1b0bc20) 00010000:00010000:0.0:1789131196.962550:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 10000000:00010000:1.0:1789131196.962553:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962559:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.962566:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.962572:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789131196.962574:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910320512:12345-0@lo:103: Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.962580:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1789131196.962586:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962591:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131196.962597:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962603:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030800/0x9f0de371879043b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879043bc expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962617:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962619:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962620:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131196.962624:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910320512:0@lo:103: 00010000:00010000:1.0:1789131196.962635:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962643:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.962649:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910320000:0@lo:103: 00000100:00100000:1.0:1789131196.962651:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320896:0@lo:104: 00000100:00100000:0.0:1789131196.962664:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910319872:0@lo:103: 00000100:00100000:1.0:1789131196.962672:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131196.962677:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131196.962683:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910320768:0@lo:103: 00000100:00100000:1.0:1789131196.962690:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320896 00000100:00100000:1.0:1789131196.962693:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320896 00000100:00100000:0.0:1789131196.962702:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131196.962708:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131196.962713:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320896:12345-0@lo:104: 00010000:00010000:1.0:1789131196.962720:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.962720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910320768 00000100:00100000:0.0:1789131196.962723:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910320768 00010000:00010000:0.0:1789131196.962734:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 20 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.962747:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789131196.962750:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131196.962753:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3307:x1876039910320768:12345-0@lo:103: 00000100:00100000:1.0:1789131196.962754:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910320896:12345-0@lo:104: Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131196.962759:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1789131196.962772:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131196.962776:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962781:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131196.962784:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962797:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.962803:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.962808:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131196.962825:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962831:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131196.962839:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962846:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c413fc000/0x9f0de3718790438b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904392 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962854:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962855:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962857:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.962878:0:8468:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.962886:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.962886:0:8468:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 20 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962896:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910321152:0@lo:104: 00000100:00100000:3.0:1789131196.962901:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789131196.962906:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789131196.962921:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789131196.962928:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131196.962929:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131196.962934:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910320256:12345-0@lo:103: 00010000:00010000:3.0:1789131196.962942:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131196.962947:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.962948:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321152 00000100:00100000:1.0:1789131196.962955:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321152 00010000:00010000:3.0:1789131196.962956:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 20 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.962965:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131196.962971:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131196.962976:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910321152:12345-0@lo:104: 00010000:00010000:1.0:1789131196.962983:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.962990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910320256:12345-0@lo:103: Request processed in 58us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131196.962997:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1789131196.963009:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131196.963013:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8468:x1876039910321152:12345-0@lo:104: Request processed in 38us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131196.963018:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789131196.963031:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131196.963034:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.963040:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b8e00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131196.963042:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.963049:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131196.963055:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131196.963060:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789131196.963073:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.963079:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131196.963096:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.963109:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8e00/0x9f0de37187904361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904368 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.963120:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.963122:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131196.963124:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131196.963136:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789131196.963150:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceac00/0x9f0de3718790441e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904417 expref: 19 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.963153:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910321280:0@lo:103: 00000100:00100000:1.0:1789131196.963159:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbda40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319616:0@lo:104: 00010000:00010000:0.0:1789131196.963244:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131196.963250:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.963267:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.963276:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131196.964076:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131196.964092:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910321024:0@lo:103: 00010000:00010000:1.0:1789131196.964185:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8400/0x9f0de371879043f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879043ed expref: 18 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.964194:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131196.964196:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbfc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319744:0@lo:104: 00010000:00010000:1.0:1789131196.964206:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fda00/0x9f0de371879043d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879043d1 expref: 17 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.964215:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320128:0@lo:104: 00010000:00010000:1.0:1789131196.964222:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879043ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879043c3 expref: 16 pid: 5839 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.964230:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbcb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320384:0@lo:104: 00000100:00100000:3.0:1789131196.964231:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789131196.964237:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321280 00010000:00010000:1.0:1789131196.964237:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40030e00/0x9f0de371879043bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879043b5 expref: 15 pid: 5838 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.964241:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321280 00000100:00100000:1.0:1789131196.964245:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320640:0@lo:104: 00000100:00100000:1.0:1789131196.964265:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910320896:0@lo:104: 00010000:00010000:3.0:1789131196.964268:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 15 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131196.964272:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910321152:0@lo:104: 00000100:00100000:3.0:1789131196.964290:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789131196.964297:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789131196.964304:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3308:x1876039910321280:12345-0@lo:103: 00010000:00010000:3.0:1789131196.964313:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131196.964318:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 15 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.964351:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 15 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.964362:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40030400/0x9f0de37187904368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904361 expref: 15 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131196.964371:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131196.964406:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3308:x1876039910321280:12345-0@lo:103: Request processed in 103us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131196.964413:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131196.964686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3307:x1876039910320768:12345-0@lo:103: Request processed in 1932us (1982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.964693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789131196.964729:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910320256:0@lo:103: 00000100:00100000:0.0:1789131196.964751:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910320768:0@lo:103: 00000100:00100000:1.0:1789131196.964810:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910321280:0@lo:103: 00000100:00100000:2.0:1789131196.965190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131196.965723:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321024 00000100:00100000:2.0:1789131196.965729:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321024 00010000:00010000:2.0:1789131196.965755:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131196.966044:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131196.966054:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3306:x1876039910321024:12345-0@lo:103: 00010000:00010000:2.0:1789131196.966066:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131196.966072:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131196.966081:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131196.966097:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031800/0x9f0de37187904392 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790438b expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131196.966108:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131196.966303:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3306:x1876039910321024:12345-0@lo:103: Request processed in 251us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131196.966311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789131196.966471:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910321024:0@lo:103: 00000100:00100000:3.0:1789131196.969732:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131196.969941:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319360:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131196.969951:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8468:1876039910319488:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131196.969989:0:8468:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131196.971675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131196.972660:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520512 00000100:00100000:2.0:1789131196.972670:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520512 00010000:00010000:2.0:1789131196.972710:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 10 pid: 5839 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131196.972832:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520640 00000100:00100000:2.0:1789131196.972837:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520640 00010000:00010000:2.0:1789131196.972863:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 11 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131196.974523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1789131196.974564:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2353:x1876039893520512:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1789131196.974585:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131196.974593:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 11 pid: 5839 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974609:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 11 pid: 5839 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974629:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceae00/0x9f0de37187904433 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394be expref: 11 pid: 5839 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974644:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131196.974714:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2353:x1876039893520512:12345-192.168.203.52@tcp:103: Request processed in 158us (4991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.974722:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1789131196.974744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1789131196.974751:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:2352:x1876039893520640:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1789131196.974770:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131196.974775:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974785:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974795:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031200/0x9f0de3718790442c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394b7 expref: 9 pid: 5838 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974806:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974825:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974843:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974850:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974857:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974864:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974870:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131196.974874:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974882:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974901:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131196.974911:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131196.974933:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:2352:x1876039893520640:12345-192.168.203.52@tcp:103: Request processed in 182us (3265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131196.974939:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00010000:00010000:1.0:1789131196.975115:0:8468:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.975124:0:8468:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131196.975131:0:8468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414a7e00/0x9f0de3718790446b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8468 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131197.017533:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131197.477845:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131197.478013:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520768 00000100:00100000:0.0:1789131197.478039:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520768 00000100:00100000:0.0:1789131197.478099:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1789131197.478109:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:5592:x1876039893520768:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1789131197.478369:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131197.478391:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031200/0x9f0de37187904472 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039520 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.478419:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031200/0x9f0de37187904472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039520 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.478431:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031200/0x9f0de37187904472 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039520 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.478441:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031200, rc 0) 00000100:00100000:0.0:1789131197.478498:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893520768:12345-192.168.203.52@tcp:101: Request processed in 391us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131197.478506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1789131197.491116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131197.498770:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893520896 00000100:00100000:1.0:1789131197.498786:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893520896 00000100:00100000:1.0:1789131197.498862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:1.0:1789131197.498873:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893520896:12345-192.168.203.52@tcp:501: 00000100:00100000:1.0:1789131197.500338:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893520896:12345-192.168.203.52@tcp:501: Request processed in 1439us (9205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131197.500352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1789131197.510996:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131197.511095:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521024 00000100:00100000:0.0:1789131197.511106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521024 00000100:00100000:0.0:1789131197.511355:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:0.0:1789131197.511367:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893521024:12345-192.168.203.52@tcp:503: 00000100:00100000:0.0:1789131197.511811:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893521024:12345-192.168.203.52@tcp:503: Request processed in 445us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131197.511820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:3.0:1789131197.522952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131197.524399:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521152 00000100:00100000:2.0:1789131197.524412:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521152 00000100:00100000:2.0:1789131197.524530:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:2.0:1789131197.524540:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:6061:x1876039893521152:12345-192.168.203.52@tcp:502: 00000100:00100000:2.0:1789131197.524880:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:6061:x1876039893521152:12345-192.168.203.52@tcp:502: Request processed in 340us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131197.524889:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1789131197.544157:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131197.548455:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521280 00000100:00100000:1.0:1789131197.548468:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521280 00000100:00100000:1.0:1789131197.548852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:1.0:1789131197.548878:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:6061:x1876039893521280:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131197.549170:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:6061:x1876039893521280:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 294us (5022us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131197.549180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1789131197.558564:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131197.565557:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521408 00000100:00100000:0.0:1789131197.565574:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521408 00000100:00100000:0.0:1789131197.565640:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:0.0:1789131197.565651:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893521408:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131197.565684:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131197.565713:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031800/0x9f0de37187904479 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039527 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.565741:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031800/0x9f0de37187904479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039527 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.565753:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031800/0x9f0de37187904479 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039527 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131197.565761:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031800, rc 0) 00000100:00100000:0.0:1789131197.565819:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893521408:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 170us (7265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131197.565828:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:3.0:1789131197.570996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131197.571097:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521536 00000100:00100000:0.0:1789131197.571107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521536 00000100:00100000:0.0:1789131197.571162:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:0.0:1789131197.571172:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893521536:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131197.571475:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893521536:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 304us (487us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131197.571485:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00010000:00010000:1.0:1789131198.041625:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131198.211294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131198.211380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131198.211415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131198.211427:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521664 00000100:00100000:2.0:1789131198.211438:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521664 00000100:00100000:3.0:1789131198.211458:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131198.211498:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521920 00000100:00100000:3.0:1789131198.211503:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521920 00000100:00100000:2.0:1789131198.211509:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:2.0:1789131198.211520:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893521664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131198.211560:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522048 00000100:00100000:3.0:1789131198.211565:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522048 00000100:00100000:3.0:1789131198.211588:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131198.211594:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893521664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.211603:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893521920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131198.211605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1789131198.211639:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893521920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.211646:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131198.211658:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1789131198.211668:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893522048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1789131198.211680:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131198.211685:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131198.211699:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893522048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.211707:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131198.211738:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893521792 00000100:00100000:1.0:1789131198.211743:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893521792 00000100:00100000:1.0:1789131198.211795:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1789131198.211804:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893521792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131198.211843:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893521792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 41us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.211848:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00080000:2.0:1789131198.211909:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131198.427089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910321536:0@lo:400: 00000100:00100000:1.0:1789131198.427157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.427162:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910321792:0@lo:400: 00000100:00100000:3.0:1789131198.427203:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.427222:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910322048:0@lo:400: 00000100:00100000:3.0:1789131198.427246:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789131198.427256:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910321408:0@lo:400: 00000100:00100000:1.0:1789131198.427258:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.427296:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.427305:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131198.427343:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910321664:0@lo:400: 00000100:00100000:3.0:1789131198.427362:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910321920:0@lo:400: 00000100:00100000:1.0:1789131198.427374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.427401:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.427422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321536 00000100:00100000:1.0:1789131198.427430:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321536 00000100:00100000:3.0:1789131198.427440:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321792 00000100:00100000:3.0:1789131198.427445:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321792 00000100:00100000:1.0:1789131198.427475:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321664 00000100:00100000:1.0:1789131198.427480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321664 00000100:00100000:1.0:1789131198.427501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321920 00000100:00100000:1.0:1789131198.427504:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321920 00000100:00100000:3.0:1789131198.427506:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322048 00000100:00100000:3.0:1789131198.427512:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322048 00000100:00100000:1.0:1789131198.427527:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131198.427539:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910321536:12345-0@lo:400: 00000100:00100000:3.0:1789131198.427544:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131198.427553:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910321792:12345-0@lo:400: 00000100:00100000:3.0:1789131198.427604:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910321792:12345-0@lo:400: Request processed in 53us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.427617:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131198.427633:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131198.427639:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910322048:12345-0@lo:400: 00000100:00100000:3.0:1789131198.427670:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910322048:12345-0@lo:400: Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.427676:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789131198.427689:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131198.427694:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131198.427695:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131198.427719:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea61c0 x1876039910321792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131198.427733:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910321792:0@lo:400: 00000100:00100000:1.0:1789131198.427804:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910321536:12345-0@lo:400: Request processed in 269us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.427809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131198.427821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789131198.427825:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910321664:12345-0@lo:400: 00000100:00100000:1.0:1789131198.427843:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910321664:12345-0@lo:400: Request processed in 19us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.427846:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789131198.427852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789131198.427856:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910321920:12345-0@lo:400: 00000100:00100000:1.0:1789131198.427878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910321920:12345-0@lo:400: Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.427882:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789131198.427897:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910321408 00000100:00100000:1.0:1789131198.427900:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910321408 00000100:00100000:1.0:1789131198.427915:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789131198.427918:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3308:x1876039910321408:12345-0@lo:400: 00000100:00100000:1.0:1789131198.427935:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3308:x1876039910321408:12345-0@lo:400: Request processed in 17us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.427950:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789131198.428060:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910321408:0@lo:400: 00000100:00100000:0.0:1789131198.430346:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910321664:0@lo:400: 00000100:00100000:0.0:1789131198.430368:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910321536:0@lo:400: 00010000:00080000:0.0:1789131198.430382:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea7480 x1876039910322048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131198.430392:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910322048:0@lo:400: 00000100:00100000:3.0:1789131198.434294:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910321920:0@lo:400: 10000000:01000000:0.0:1789131198.938403:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789131198.938411:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0b41ae9800 from 39 10000000:01000000:0.0:1789131198.938416:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131198.938466:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938477:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938487:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.938509:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322176:0@lo:101: 00000100:00100000:0.0:1789131198.938576:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.938625:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.938647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322176 00000100:00100000:0.0:1789131198.938652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322176 00000100:00100000:0.0:1789131198.938695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789131198.938704:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910322176:12345-0@lo:101: 00010000:00010000:0.0:1789131198.938716:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131198.938727:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40030800/0x9f0de37187904487 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904480 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938748:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40030800/0x9f0de37187904487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904480 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938757:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40030800/0x9f0de37187904487 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904480 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938766:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40030800, rc 0) 00000100:00100000:0.0:1789131198.938817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322176:12345-0@lo:101: Request processed in 113us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.938823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789131198.938868:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322176:0@lo:101: 00010000:00010000:0.0:1789131198.938881:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.938889:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.938933:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322304:0@lo:501: 00000100:00100000:0.0:1789131198.938954:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.938968:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.938979:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322304 00000100:00100000:0.0:1789131198.938983:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322304 00000100:00100000:0.0:1789131198.939002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789131198.939009:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322304:12345-0@lo:501: 00000100:00100000:0.0:1789131198.939217:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322304:12345-0@lo:501: Request processed in 208us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.939225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789131198.939250:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322304:0@lo:501: 00000100:00100000:0.0:1789131198.939274:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322432:0@lo:503: 00000100:00100000:0.0:1789131198.939319:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.939360:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.939371:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322432 00000100:00100000:0.0:1789131198.939375:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322432 00000100:00100000:0.0:1789131198.939395:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789131198.939407:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322432:12345-0@lo:503: 00000100:00100000:0.0:1789131198.939535:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322432:12345-0@lo:503: Request processed in 128us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.939542:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789131198.939580:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322432:0@lo:503: 00000100:00100000:0.0:1789131198.939747:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8522:1876039910322560:0@lo:502: 00000100:00100000:0.0:1789131198.939779:0:8522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.939798:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322560 00000100:00100000:0.0:1789131198.939801:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322560 00000100:00100000:0.0:1789131198.939821:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789131198.939827:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8522:x1876039910322560:12345-0@lo:502: 00000100:00100000:0.0:1789131198.939965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8522:x1876039910322560:12345-0@lo:502: Request processed in 137us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.939972:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789131198.939998:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.940010:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8522:1876039910322560:0@lo:502: 00000100:00100000:0.0:1789131198.940043:0:8522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8522:1876039910322688:0@lo:502: 00000100:00100000:0.0:1789131198.940073:0:8522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.940089:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322688 00000100:00100000:0.0:1789131198.940092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322688 00000100:00100000:0.0:1789131198.940108:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789131198.940113:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8522:x1876039910322688:12345-0@lo:502: 00000100:00100000:0.0:1789131198.940214:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8522:x1876039910322688:12345-0@lo:502: Request processed in 100us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.940220:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789131198.940251:0:8522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509eae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.940262:0:8522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8522:1876039910322688:0@lo:502: 00000040:00080000:0.0:1789131198.940277:0:8522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789131198.940351:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789131198.940366:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789131198.940372:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940382:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131198.940390:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789131198.940392:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789131198.940394:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789131198.940412:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940419:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940427:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.940437:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322816:0@lo:101: 00000100:00100000:0.0:1789131198.940458:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.940474:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43091540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.940483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322816 00000100:00100000:0.0:1789131198.940486:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322816 00000100:00100000:0.0:1789131198.940502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789131198.940508:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910322816:12345-0@lo:101: 00010000:00010000:0.0:1789131198.940520:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131198.940529:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790448e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940544:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790448e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940552:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790448e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940560:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40030a00, rc 0) 00000100:00100000:0.0:1789131198.940583:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910322816:12345-0@lo:101: Request processed in 75us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.940589:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789131198.940613:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322816:0@lo:101: 00010000:00010000:0.0:1789131198.940623:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.940632:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.940660:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322944:0@lo:501: 00000100:00100000:0.0:1789131198.940679:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.940689:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.940698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910322944 00000100:00100000:0.0:1789131198.940700:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910322944 00000100:00100000:0.0:1789131198.940716:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789131198.940721:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910322944:12345-0@lo:501: 00000100:00100000:0.0:1789131198.940898:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910322944:12345-0@lo:501: Request processed in 176us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.940905:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789131198.940931:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910322944:0@lo:501: 00000100:00100000:0.0:1789131198.940951:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910323072:0@lo:503: 00000100:00100000:0.0:1789131198.940984:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.940997:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509eaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.941007:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323072 00000100:00100000:0.0:1789131198.941010:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323072 00000100:00100000:0.0:1789131198.941030:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789131198.941036:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910323072:12345-0@lo:503: 00000100:00100000:0.0:1789131198.941149:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910323072:12345-0@lo:503: Request processed in 112us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.941155:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789131198.941184:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910323072:0@lo:503: 00000020:00000080:1.0:1789131198.944492:0:8521:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd69ef9d20 20000000:00000080:1.0:1789131198.944508:0:8521:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c7a643800 uarg=0000000000000000 20000000:01000000:1.0:1789131198.944539:0:8521:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789131198.944545:0:8521:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789131198.944549:0:8521:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789131198.945026:0:8524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1789131198.945071:0:8521:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000100:00100000:0.0:1789131198.945445:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910323200:0@lo:13: 00000100:00100000:0.0:1789131198.945504:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.945551:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323200 00000100:00100000:0.0:1789131198.945557:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323200 00000100:00100000:0.0:1789131198.945603:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789131198.945612:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910323200:12345-0@lo:13: 00002000:00000024:0.0:1789131198.945644:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131198.945686:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910323200:12345-0@lo:13: Request processed in 75us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.945693:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789131198.945738:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e90b40 x1876039910323200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131198.945755:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910323200:0@lo:13: 00000100:00100000:3.0:1789131198.948621:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8523:1876039910323328:0@lo:502: 00000100:00100000:3.0:1789131198.948707:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.948784:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15b40 going to sleep for 11 seconds 00000040:00080000:1.0:1789131198.950430:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789131198.950484:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789131198.950539:0:8521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789131198.950556:0:8521:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789131198.950575:0:8521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950591:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879042a4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950598:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790431b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950606:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790437d expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950615:0:8521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950622:0:8521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950652:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950668:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 9 pid: 5837 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.950680:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323456:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131198.950748:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950766:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 13 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.950776:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323584:0@lo:104: 00000100:00100000:1.0:1789131198.950810:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131198.950843:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950851:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 13 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.950860:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323712:0@lo:104: 00000100:00100000:1.0:1789131198.950881:0:8521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131198.950901:0:8521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.950908:0:8521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 13 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.950916:0:8521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323840:0@lo:104: 00000100:00100000:1.0:1789131198.950932:0:8521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131198.950965:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789131198.950980:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.950991:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323584 00000100:00100000:1.0:1789131198.950996:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323584 00000100:00100000:1.0:1789131198.951029:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323712 00000100:00100000:1.0:1789131198.951032:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323712 00000100:00100000:1.0:1789131198.951045:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323840 00000100:00100000:1.0:1789131198.951047:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323840 00000100:00100000:1.0:1789131198.951070:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131198.951077:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:8521:x1876039910323584:12345-0@lo:104: 00010000:00010000:1.0:1789131198.951088:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951133:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131198.951139:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:8521:x1876039910323584:12345-0@lo:104: Request processed in 63us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.951145:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131198.951160:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131198.951165:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:8521:x1876039910323712:12345-0@lo:104: 00010000:00010000:1.0:1789131198.951173:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951199:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789131198.951203:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c436b6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:8521:x1876039910323712:12345-0@lo:104: Request processed in 39us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.951207:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131198.951237:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131198.951242:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8521:x1876039910323840:12345-0@lo:104: 00010000:00010000:1.0:1789131198.951248:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951271:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789131198.951276:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:8521:x1876039910323840:12345-0@lo:104: Request processed in 35us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.951281:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789131198.951296:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789131198.951306:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951352:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131198.951356:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951364:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131198.951371:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131198.951376:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789131198.951397:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951403:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131198.951419:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951426:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de3718790437d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904384 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951437:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131198.951440:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951446:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131198.951448:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951465:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131198.951471:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131198.951476:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789131198.951489:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951495:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131198.951501:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951507:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a6200/0x9f0de3718790431b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904329 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951520:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131198.951523:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951528:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131198.951531:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951537:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131198.951543:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131198.951553:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789131198.951566:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951571:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131198.951584:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de371879042a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879042ab expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951602:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131198.951603:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131198.951605:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131198.951630:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323584:0@lo:104: 00000100:00100000:1.0:1789131198.951638:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323712:0@lo:104: 00000100:00100000:1.0:1789131198.951643:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323840:0@lo:104: 00000100:00100000:1.0:1789131198.951677:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910324224:0@lo:103: 00000100:00100000:1.0:1789131198.951704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.951736:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910324096:0@lo:103: 00000100:00100000:1.0:1789131198.951758:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.951774:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131198.951779:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910323968:0@lo:103: 00000100:00100000:1.0:1789131198.951796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131198.951818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324224 00000100:00100000:1.0:1789131198.951822:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324224 00010000:00010000:1.0:1789131198.951839:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 14 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.951865:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324096 00000100:00100000:1.0:1789131198.951868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324096 00010000:00010000:1.0:1789131198.951879:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 15 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.951890:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323968 00000100:00100000:1.0:1789131198.951892:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323968 00010000:00010000:1.0:1789131198.951903:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 16 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.951914:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131198.951920:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3306:x1876039910324224:12345-0@lo:103: 00010000:00010000:1.0:1789131198.951928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131198.951933:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951942:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951954:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8200/0x9f0de371879042ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879042a4 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.951965:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131198.951992:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3306:x1876039910324224:12345-0@lo:103: Request processed in 72us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.951999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131198.952013:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131198.952020:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3309:x1876039910324096:12345-0@lo:103: 00010000:00010000:1.0:1789131198.952035:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131198.952040:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 14 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952048:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 14 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952059:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904329 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790431b expref: 14 pid: 5837 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952068:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131198.952095:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:3309:x1876039910324096:12345-0@lo:103: Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.952101:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131198.952113:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131198.952119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:3309:x1876039910323968:12345-0@lo:103: 00010000:00010000:1.0:1789131198.952125:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131198.952129:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 12 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952137:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 12 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952145:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fc800/0x9f0de37187904384 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790437d expref: 12 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.952152:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131198.952169:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:3309:x1876039910323968:12345-0@lo:103: Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.952174:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131198.952208:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910324224:0@lo:103: 00000100:00100000:1.0:1789131198.952225:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910323968:0@lo:103: 00000100:00100000:1.0:1789131198.952232:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910324096:0@lo:103: 00010000:00010000:2.0:1789131198.952548:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131198.952963:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910323328 00000100:00100000:0.0:1789131198.952968:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910323328 00000100:00100000:0.0:1789131198.953035:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789131198.953043:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:8523:x1876039910323328:12345-0@lo:502: 00000100:00100000:0.0:1789131198.953217:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:8523:x1876039910323328:12345-0@lo:502: Request processed in 175us (4510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.953224:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131198.954453:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8523:1876039910323328:0@lo:502: 00000020:01000000:3.0:1789131198.954485:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131198.954493:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131198.954496:0:8523:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789131198.954500:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789131198.954533:0:8523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8523:1876039910324352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.954588:0:8523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.954810:0:8523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.954881:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324352 00000100:00100000:2.0:1789131198.954887:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324352 00000100:00100000:2.0:1789131198.954919:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789131198.954926:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:8523:x1876039910324352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131198.955114:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:8523:x1876039910324352:12345-0@lo:502:llog_process_th.0 Request processed in 187us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.955122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789131198.955213:0:8523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8523:1876039910324352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131198.955232:0:8523:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131198.955236:0:8523:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131198.955238:0:8523:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789131198.955241:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789131198.955413:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789131198.955430:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789131198.955439:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.955450:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131198.955459:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131198.955462:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0b41ae9800 from 4 10000000:01000000:2.0:1789131198.955464:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131198.955487:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.955503:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.955513:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131198.955528:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131198.955554:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131198.955581:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52ea9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.955671:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324480 00000100:00100000:0.0:1789131198.955675:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324480 00000100:00100000:0.0:1789131198.955698:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789131198.955705:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+11:5842:x1876039910324480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131198.955713:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131198.955723:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044a3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.955741:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.955750:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 4/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.955763:0:5838:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.955774:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.955789:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c40031000, rc 0) 00000100:00100000:0.0:1789131198.955816:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910324480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.955821:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789131198.956037:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131198.956048:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.956056:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 4/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.960721:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131198.960795:0:8521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8521:1876039910323456:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131198.960831:0:8521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131198.961003:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522176 00000100:00100000:3.0:1789131198.961008:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522176 00010000:00010000:3.0:1789131198.961039:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131198.961067:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1789131198.961077:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893522176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131198.961090:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131198.961096:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961113:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961131:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187904441 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394ef expref: 10 pid: 5837 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961144:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961151:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961166:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961195:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961202:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961208:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961214:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131198.961218:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961226:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961255:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961262:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.961285:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131198.961299:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5830:1876039910324608:0@lo:105: 00000100:00100000:3.0:1789131198.961370:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.961399:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15540 going to sleep for 11 seconds 00010000:00010000:2.0:1789131198.961519:0:8521:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.961527:0:8521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131198.961743:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324608 00000100:00100000:1.0:1789131198.961748:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324608 00000100:00100000:1.0:1789131198.961783:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131198.961790:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5830:x1876039910324608:12345-0@lo:105: 00010000:00010000:1.0:1789131198.961799:0:5828:0:(ldlm_lockd.c:2518:ldlm_callback_handler()) ### completion ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.961807:0:5828:0:(ldlm_lockd.c:1968:ldlm_handle_cp_callback()) ### client completion callback handler START ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 5/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.961815:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 5/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.961822:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11080000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.961828:0:5828:0:(ldlm_lockd.c:2073:ldlm_handle_cp_callback()) ### callback handler finished, about to run_ast_work ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 6/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1080000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131198.961844:0:5828:0:(ldlm_lockd.c:2084:ldlm_handle_cp_callback()) ### client completion callback handler END (lock ffff9c0b41cea400) 00000100:00100000:1.0:1789131198.961878:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:5830:x1876039910324608:12345-0@lo:105: Request processed in 90us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.961885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1789131198.961950:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.961959:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.962011:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.962041:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.962068:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131198.962191:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:5830:1876039910324608:0@lo:105: 00010000:00010000:3.0:1789131198.962205:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.962219:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414a6c00/0x9f0de3718790449c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 8521 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.962231:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131198.962902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:2352:x1876039893522176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1824us (2186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.962910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1789131198.963357:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324736 00000100:00100000:1.0:1789131198.963363:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324736 00000100:00100000:1.0:1789131198.963390:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789131198.963398:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910324736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131198.963633:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910324736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 234us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.963639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789131198.963810:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.963848:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.963883:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.963913:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131198.963953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324864 00000100:00100000:1.0:1789131198.963957:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324864 00000100:00100000:1.0:1789131198.963987:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789131198.963994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910324864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131198.964139:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910324864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131198.964145:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789131198.965370:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910324864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.968891:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8525:1876039910324992:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131198.968967:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.969011:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131198.969015:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910324992 00000100:00100000:3.0:1789131198.969022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910324992 00000100:00100000:3.0:1789131198.969082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789131198.969092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:8525:x1876039910324992:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.969296:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:8525:x1876039910324992:12345-0@lo:502:llog_process_th.0 Request processed in 205us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.969303:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789131198.969360:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8525:1876039910324992:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131198.969385:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131198.969394:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131198.969396:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789131198.969403:0:8525:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0b41ae9800 00000020:00000080:0.0:1789131198.969411:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789131198.970140:0:8525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8525:1876039910325120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131198.970185:0:8525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131198.970217:0:8525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52ea9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.970350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325120 00000100:00100000:0.0:1789131198.970356:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325120 00000100:00100000:0.0:1789131198.970389:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789131198.970397:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:8525:x1876039910325120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131198.970546:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:8525:x1876039910325120:12345-0@lo:502:llog_process_th.0 Request processed in 150us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.970553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789131198.971126:0:8525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8525:1876039910325120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131198.971153:0:8525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131198.971159:0:8525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131198.971161:0:8525:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789131198.971165:0:8525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789131198.971350:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789131198.971368:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131198.971378:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.971388:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131198.971398:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789131198.971400:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43172800 from 39 10000000:01000000:0.0:1789131198.971403:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131198.971431:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.971438:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.971446:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.971460:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.971490:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.971530:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b431473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.971711:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325248 00000100:00100000:2.0:1789131198.971716:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325248 00000100:00100000:2.0:1789131198.971752:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789131198.971759:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+12:5842:x1876039910325248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131198.971768:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131198.971778:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceb600/0x9f0de371879044b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044b1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.971798:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceb600/0x9f0de371879044b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044b1 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.971808:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceb600/0x9f0de371879044b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044b1 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131198.971817:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb600, rc 0) 00000100:00100000:2.0:1789131198.971854:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.971861:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789131198.972001:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131198.972013:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131198.972021:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131198.972063:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.972088:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.972109:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b431473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.972334:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325376 00000100:00100000:2.0:1789131198.972338:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325376 00000100:00100000:2.0:1789131198.972367:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789131198.972373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131198.972577:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 203us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.972584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789131198.973005:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.973037:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.973073:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.973108:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b431473c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.973192:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325504 00000100:00100000:2.0:1789131198.973197:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325504 00000100:00100000:2.0:1789131198.973222:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789131198.973229:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131198.973398:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.973405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789131198.973439:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.976109:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8527:1876039910325632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.976172:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.976211:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.976351:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325632 00000100:00100000:2.0:1789131198.976358:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325632 00000100:00100000:2.0:1789131198.976405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789131198.976413:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8527:x1876039910325632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131198.976625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8527:x1876039910325632:12345-0@lo:502:llog_process_th.0 Request processed in 212us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.976632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789131198.976764:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8527:1876039910325632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.976808:0:8527:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8527:1876039910325760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.976839:0:8527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.976866:0:8527:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131198.976906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325760 00000100:00100000:2.0:1789131198.976910:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325760 00000100:00100000:2.0:1789131198.979094:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789131198.979112:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8527:x1876039910325760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131198.979404:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:8527:x1876039910325760:12345-0@lo:502:llog_process_th.0 Request processed in 298us (2563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131198.979412:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789131198.979703:0:8527:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8527:1876039910325760:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789131198.979743:0:8527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789131198.982384:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789131198.982413:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789131198.982423:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982435:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131198.982445:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789131198.982447:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1789131198.982450:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789131198.982660:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982668:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982679:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131198.982703:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.982766:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.982804:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131198.982822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910325888 00000100:00100000:3.0:1789131198.982827:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910325888 00000100:00100000:3.0:1789131198.982868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789131198.982877:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+13:5842:x1876039910325888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131198.982890:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131198.982901:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b9800/0x9f0de371879044c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044bf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982933:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b9800/0x9f0de371879044c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044bf expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982943:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b9800/0x9f0de371879044c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044bf expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.982952:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b9800, rc 0) 00000100:00100000:3.0:1789131198.982986:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910325888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.982992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789131198.983031:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910325888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131198.983043:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131198.983051:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131198.983095:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.983129:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.985316:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.987750:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326016 00000100:00100000:0.0:1789131198.988010:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326016 00000100:00100000:0.0:1789131198.988387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789131198.988398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910326016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.989371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910326016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 972us (6238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.989382:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789131198.991276:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.991356:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.991418:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131198.991458:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131198.991740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326144 00000100:00100000:0.0:1789131198.991756:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326144 00000100:00100000:0.0:1789131198.992026:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789131198.992036:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910326144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131198.993319:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131198.994720:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910326144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 988us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131198.994742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789131198.997945:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8531:1876039910326272:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131198.998859:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131198.998901:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131198.999298:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326272 00000100:00100000:3.0:1789131198.999306:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326272 00000100:00100000:3.0:1789131198.999378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789131198.999388:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:8531:x1876039910326272:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131198.999612:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:8531:x1876039910326272:12345-0@lo:502:llog_process_th.0 Request processed in 225us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131198.999621:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789131198.999932:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8531:1876039910326272:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131198.999966:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131198.999974:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131198.999977:0:8531:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789131198.999982:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789131199.000012:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8531:1876039910326400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131199.000049:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131199.000081:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.000915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326400 00000100:00100000:2.0:1789131199.000923:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326400 00000100:00100000:2.0:1789131199.000979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789131199.000988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:8531:x1876039910326400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.002671:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:8531:x1876039910326400:12345-0@lo:502:llog_process_th.0 Request processed in 1678us (2616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.002684:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789131199.002866:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8531:1876039910326400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131199.002902:0:8531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131199.002909:0:8531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131199.002912:0:8531:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789131199.002917:0:8531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789131199.003051:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789131199.003075:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789131199.003087:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.003099:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131199.003264:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131199.003268:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172800 from 4 10000000:01000000:2.0:1789131199.003271:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131199.003302:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.004224:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.004242:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131199.004272:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.004354:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.004399:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131199.004593:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326528 00000100:00100000:0.0:1789131199.004600:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326528 00000100:00100000:0.0:1789131199.004647:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789131199.004655:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:5842:x1876039910326528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131199.004669:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131199.004693:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044cd expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.004723:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044cd expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.004734:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044cd expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.004743:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131199.004789:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910326528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131199.004796:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789131199.012380:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131199.012408:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.012420:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131199.012494:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131199.012554:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131199.012604:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b431473c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.012677:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326656 00000100:00100000:1.0:1789131199.012684:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326656 00000100:00100000:1.0:1789131199.012730:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789131199.012739:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910326656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.012973:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910326656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.012981:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789131199.013000:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.013031:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.013069:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.013095:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.013152:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326784 00000100:00100000:1.0:1789131199.013156:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326784 00000100:00100000:1.0:1789131199.013185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789131199.013192:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910326784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.013357:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910326784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.013370:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789131199.013566:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910326784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.016738:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8533:1876039910326912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.016813:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.016854:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.016902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910326912 00000100:00100000:1.0:1789131199.016909:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910326912 00000100:00100000:1.0:1789131199.016953:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789131199.016962:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:8533:x1876039910326912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.017291:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:8533:x1876039910326912:12345-0@lo:502:llog_process_th.0 Request processed in 330us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.017301:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789131199.017432:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8533:1876039910326912:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131199.017457:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131199.017465:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131199.017468:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789131199.017474:0:8533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43172800 00000020:00000080:3.0:1789131199.017476:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789131199.017539:0:8533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8533:1876039910327040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.017573:0:8533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131199.019556:0:8533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.019608:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327040 00000100:00100000:2.0:1789131199.019615:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327040 00000100:00100000:2.0:1789131199.019698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789131199.019709:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:8533:x1876039910327040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.019931:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:8533:x1876039910327040:12345-0@lo:502:llog_process_th.0 Request processed in 224us (2357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.019939:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789131199.020209:0:8533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8533:1876039910327040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131199.020242:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131199.020260:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131199.020263:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789131199.020268:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789131199.022371:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789131199.022396:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131199.022408:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022420:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131199.022430:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789131199.022433:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43124000 from 39 10000000:01000000:2.0:1789131199.022436:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789131199.022476:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022603:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022614:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131199.022637:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.022694:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.022731:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.022748:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327168 00000100:00100000:2.0:1789131199.022753:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327168 00000100:00100000:2.0:1789131199.022795:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789131199.022803:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:5842:x1876039910327168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131199.022816:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131199.022828:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea600/0x9f0de371879044e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044db expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022850:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea600/0x9f0de371879044e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044db expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022860:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41cea600/0x9f0de371879044e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044db expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022869:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea600, rc 0) 00000100:00100000:2.0:1789131199.022903:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.022909:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789131199.022959:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131199.022973:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.022981:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131199.023025:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.023049:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.023060:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.023071:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327296 00000100:00100000:2.0:1789131199.023074:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327296 00000100:00100000:2.0:1789131199.023091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789131199.023097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.023507:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 408us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.023514:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789131199.023547:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.023575:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.023612:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.023625:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5078bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.023637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327424 00000100:00100000:2.0:1789131199.023640:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327424 00000100:00100000:2.0:1789131199.023660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789131199.023665:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.023795:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.023808:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789131199.023843:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.027732:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8535:1876039910327552:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.027813:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.027853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327552 00000100:00100000:2.0:1789131199.027860:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327552 00000100:00100000:2.0:1789131199.027898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789131199.027907:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:8535:x1876039910327552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.028286:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:8535:x1876039910327552:12345-0@lo:502:llog_process_th.0 Request processed in 379us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.028294:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789131199.028385:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.028408:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8535:1876039910327552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.028545:0:8535:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8535:1876039910327680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.028580:0:8535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131199.028641:0:8535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131199.028671:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327680 00000100:00100000:2.0:1789131199.028676:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327680 00000100:00100000:2.0:1789131199.028738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789131199.028746:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:8535:x1876039910327680:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131199.028904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:8535:x1876039910327680:12345-0@lo:502:llog_process_th.0 Request processed in 160us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131199.028910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789131199.028965:0:8535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8535:1876039910327680:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789131199.028986:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789131199.029100:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789131199.029246:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789131199.029257:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.029268:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131199.029289:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789131199.029291:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1789131199.029294:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789131199.029355:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.029363:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.029372:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131199.029388:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.029419:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.029436:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.029505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327808 00000100:00100000:3.0:1789131199.029509:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327808 00000100:00100000:3.0:1789131199.029542:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789131199.029549:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910327808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131199.029558:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131199.029570:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8200/0x9f0de371879044f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.029590:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8200/0x9f0de371879044f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044e9 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.029601:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8200/0x9f0de371879044f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044e9 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.029609:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8200, rc 0) 00000100:00100000:3.0:1789131199.029647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910327808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.029654:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789131199.029733:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131199.029747:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131199.029756:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131199.029803:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131199.029833:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131199.029888:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.029922:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910327936 00000100:00100000:3.0:1789131199.029927:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910327936 00000100:00100000:3.0:1789131199.029949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789131199.029955:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910327936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.030193:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910327936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.030201:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789131199.030393:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910327936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.030423:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.030458:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131199.030477:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.030494:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328064 00000100:00100000:3.0:1789131199.030498:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328064 00000100:00100000:3.0:1789131199.030520:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789131199.030528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910328064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.030671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910328064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.030677:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789131199.030716:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.032583:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8538:1876039910328192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.032647:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.032684:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c456633c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.032727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328192 00000100:00100000:3.0:1789131199.032734:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328192 00000100:00100000:3.0:1789131199.032805:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789131199.032815:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:8538:x1876039910328192:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.033032:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:8538:x1876039910328192:12345-0@lo:502:llog_process_th.0 Request processed in 218us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.033040:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789131199.033234:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8538:1876039910328192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131199.033269:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131199.033276:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131199.033279:0:8538:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789131199.033285:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789131199.033306:0:8538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8538:1876039910328320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.033372:0:8538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.033395:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328320 00000100:00100000:1.0:1789131199.033399:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328320 00000100:00100000:1.0:1789131199.033422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789131199.033429:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:8538:x1876039910328320:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.033557:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:8538:x1876039910328320:12345-0@lo:502:llog_process_th.0 Request processed in 128us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.033564:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789131199.033599:0:8538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c456633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.033611:0:8538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8538:1876039910328320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131199.033628:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131199.033632:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131199.033633:0:8538:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789131199.033637:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789131199.033779:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789131199.033798:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789131199.033807:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.033818:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131199.033828:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789131199.033830:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 4 10000000:01000000:3.0:1789131199.033833:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789131199.033858:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.033875:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.033885:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131199.033898:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.033927:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131199.033956:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.034013:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328448 00000100:00100000:1.0:1789131199.034017:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328448 00000100:00100000:1.0:1789131199.034077:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789131199.034085:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910328448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131199.034093:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131199.034104:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879044f7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.034267:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.034278:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.034287:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:1.0:1789131199.034417:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910328448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 332us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.034425:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789131199.034476:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131199.034488:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.034496:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131199.034541:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.034570:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131199.034721:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1300 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.034753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328576 00000100:00100000:1.0:1789131199.034757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328576 00000100:00100000:1.0:1789131199.034812:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789131199.034820:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910328576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.035037:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910328576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.035050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789131199.035479:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.035513:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.035551:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.035610:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45663b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.035642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328704 00000100:00100000:3.0:1789131199.035648:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328704 00000100:00100000:3.0:1789131199.035711:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789131199.035720:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910328704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.035866:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910328704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.035873:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789131199.035938:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910328704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.037253:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8539:1876039910328832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.037406:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.037464:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.037496:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328832 00000100:00100000:3.0:1789131199.037501:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328832 00000100:00100000:3.0:1789131199.037565:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789131199.037573:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:8539:x1876039910328832:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.037752:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:8539:x1876039910328832:12345-0@lo:502:llog_process_th.0 Request processed in 179us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.037760:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789131199.037821:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8539:1876039910328832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131199.037846:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131199.037854:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131199.037857:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789131199.037863:0:8539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43124000 00000020:00000080:1.0:1789131199.037866:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789131199.037921:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8539:1876039910328960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131199.037953:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.037969:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74781c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131199.038001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910328960 00000100:00100000:3.0:1789131199.038005:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910328960 00000100:00100000:3.0:1789131199.038062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789131199.038070:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:8539:x1876039910328960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131199.038196:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:8539:x1876039910328960:12345-0@lo:502:llog_process_th.0 Request processed in 127us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.038203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789131199.038389:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:8539:1876039910328960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131199.038409:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131199.038413:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131199.038414:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789131199.038418:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789131199.038462:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789131199.038485:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789131199.038494:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038504:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131199.038513:0:5842:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789131199.038515:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c0c492c0000 from 1 10000000:01000000:1.0:1789131199.038517:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789131199.038540:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038548:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038557:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131199.038569:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910329088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.038595:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.038610:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74781c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.038622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329088 00000100:00100000:1.0:1789131199.038625:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329088 00000100:00100000:1.0:1789131199.038642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789131199.038648:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910329088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131199.038657:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131199.038667:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414a6e00/0x9f0de3718790450c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904505 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038697:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414a6e00/0x9f0de3718790450c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904505 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038707:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414a6e00/0x9f0de3718790450c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904505 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038715:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6e00, rc 0) 00000100:00100000:1.0:1789131199.038744:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910329088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.038750:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789131199.038777:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910329088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131199.038789:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.038798:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131199.038836:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910329216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.038858:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131199.038871:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74781c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131199.038881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329216 00000100:00100000:1.0:1789131199.038884:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329216 00000100:00100000:1.0:1789131199.038900:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789131199.038906:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910329216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.039082:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910329216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (223us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131199.039098:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789131199.039660:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910329216:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789131199.039693:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789131199.039702:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131199.039710:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131199.067539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131199.097461:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131199.097537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522304 00000100:00100000:0.0:1789131199.097551:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522304 00000100:00100000:0.0:1789131199.097599:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:0.0:1789131199.097608:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:5592:x1876039893522304:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131199.097625:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131199.097640:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03952e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.097670:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.097683:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131199.097694:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14800, rc 0) 00000100:00100000:0.0:1789131199.097744:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893522304:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131199.097752:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1789131199.111523:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131199.111689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522432 00000100:00100000:1.0:1789131199.111699:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522432 00000100:00100000:1.0:1789131199.111751:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1789131199.111761:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893522432:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131199.112030:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893522432:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 270us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.112039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:1.0:1789131199.118095:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131199.118180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522560 00000100:00100000:3.0:1789131199.118425:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522560 00000100:00100000:3.0:1789131199.118477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:3.0:1789131199.118773:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893522560:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131199.119075:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:5592:x1876039893522560:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 307us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.119085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:3.0:1789131199.122933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131199.123013:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522688 00000100:00100000:1.0:1789131199.123023:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522688 00000100:00100000:1.0:1789131199.123085:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1789131199.123094:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:6097:x1876039893522688:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131199.123390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:6097:x1876039893522688:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 296us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131199.123398:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:1.0:1789131199.125435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131199.125521:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522816 00000100:00100000:3.0:1789131199.125531:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522816 00000100:00100000:3.0:1789131199.125592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:3.0:1789131199.125602:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:6097:x1876039893522816:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131199.125824:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:6097:x1876039893522816:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 223us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131199.125832:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00010000:00010000:3.0:1789131200.095828:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131201.114518:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131202.010301:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910329344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131202.010398:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131202.010549:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329344 00000100:00100000:0.0:1789131202.010557:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329344 00000100:00100000:0.0:1789131202.010618:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789131202.010628:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910329344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131202.010663:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131202.010708:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910329344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131202.010715:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789131202.010802:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403f840 x1876039910329344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131202.010822:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910329344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789131202.010944:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789131202.138247:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131203.162650:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131203.347931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131203.348022:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131203.348051:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131203.348077:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131203.348298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523072 00000100:00100000:3.0:1789131203.348308:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523072 00000100:00100000:3.0:1789131203.348390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1789131203.348403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893523072:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131203.348472:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893523072:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131203.348481:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1789131203.348766:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523328 00000100:00100000:3.0:1789131203.348771:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523328 00000100:00100000:3.0:1789131203.348821:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523200 00000100:00100000:3.0:1789131203.348825:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523200 00000100:00100000:3.0:1789131203.348852:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131203.348860:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893523328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131203.348890:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893523328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131203.348907:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131203.348920:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131203.348927:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893523200:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131203.348954:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893523200:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131203.348961:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131203.348977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893522944 00000100:00100000:3.0:1789131203.348981:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893522944 00000100:00100000:3.0:1789131203.349006:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:3.0:1789131203.349012:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2354:x1876039893522944:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131203.349035:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2354:x1876039893522944:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131203.349044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00080000:3.0:1789131203.349073:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131203.349077:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131203.349080:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131203.549364:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910329472:0@lo:400:kworker.0 00000100:00100000:3.0:1789131203.549442:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131203.549600:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329472 00000100:00100000:1.0:1789131203.549608:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329472 00000100:00100000:1.0:1789131203.549659:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789131203.549669:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910329472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131203.550731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910329472:12345-0@lo:400:kworker.0 Request processed in 1060us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131203.550741:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789131203.550791:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910329600:0@lo:400:kworker.0 00000100:00100000:1.0:1789131203.550823:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131203.550862:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329600 00000100:00100000:1.0:1789131203.550867:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329600 00000100:00100000:1.0:1789131203.550897:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131203.550904:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910329600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131203.550942:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910329600:12345-0@lo:400:kworker.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131203.550947:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131203.550981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910329600:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.555751:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910329856:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.555825:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131203.555868:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131203.555874:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910329728:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.555899:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131203.555926:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910330112:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.555949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131203.555967:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131203.555972:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910329984:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.555992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131203.556018:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329856 00000100:00100000:2.0:1789131203.556025:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329856 00000100:00100000:2.0:1789131203.556066:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330112 00000100:00100000:2.0:1789131203.556069:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330112 00000100:00100000:2.0:1789131203.556230:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131203.556239:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910329856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.556303:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910329856:12345-0@lo:400:kworker.0 Request processed in 65us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131203.556310:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131203.556358:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131203.556365:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910330112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.556396:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910330112:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131203.556402:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131203.556419:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329728 00000100:00100000:2.0:1789131203.556422:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329728 00000100:00100000:2.0:1789131203.556447:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910329984 00000100:00100000:2.0:1789131203.556449:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910329984 00000100:00100000:2.0:1789131203.556478:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131203.556484:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910329728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.556584:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910329728:12345-0@lo:400:kworker.0 Request processed in 101us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131203.556590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131203.556601:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131203.556606:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910329984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.556628:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910329984:12345-0@lo:400:kworker.0 Request processed in 23us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131203.556633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789131203.556658:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789131203.556663:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131203.556710:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910329984:0@lo:400:kworker.0 00010000:00080000:2.0:1789131203.556722:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403fc00 x1876039910330112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131203.556732:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910330112:0@lo:400:kworker.0 00000100:00100000:2.0:1789131203.556758:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910329728:0@lo:400:kworker.0 00010000:00080000:2.0:1789131203.556769:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403e1c0 x1876039910329856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131203.556777:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910329856:0@lo:400:kworker.0 00000100:00100000:3.0:1789131203.557016:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910329472:0@lo:400:kworker.0 00000100:00100000:0.0:1789131204.057530:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131204.057557:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910330240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131204.057630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131204.057698:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330240 00000100:00100000:0.0:1789131204.057705:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330240 00000100:00100000:0.0:1789131204.057746:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131204.057754:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910330240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131204.057786:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131204.057927:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910330240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131204.057934:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789131204.057967:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e90b40 x1876039910330240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131220 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131204.057983:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910330240:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131204.186583:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131205.209794:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131205.689083:0:8829:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789131206.233496:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131207.131167:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131207.131193:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910330368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131207.131277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131207.132250:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330368 00000100:00100000:2.0:1789131207.132273:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330368 00000100:00080000:0.0:1789131207.132402:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131207.132530:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131207.132554:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910330368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789131207.132595:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131207.133177:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910330368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 623us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131207.133185:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789131207.138021:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403e1c0 x1876039910330368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131207.138052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910330368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131207.257636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131208.285461:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131208.463101:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131208.463150:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131208.463187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131208.463216:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523584 00000100:00100000:2.0:1789131208.463224:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523584 00000100:00100000:2.0:1789131208.463297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1789131208.463308:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893523584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131208.463403:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893523584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.463410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1789131208.463455:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131208.463560:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523712 00000100:00100000:2.0:1789131208.463564:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523712 00000100:00100000:2.0:1789131208.463594:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523840 00000100:00100000:2.0:1789131208.463597:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523840 00000100:00100000:2.0:1789131208.463616:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1789131208.463623:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893523712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131208.463658:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893523712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.463664:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1789131208.463677:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1789131208.463697:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893523840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131208.463720:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893523840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.463726:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1789131208.463858:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523456 00000100:00100000:1.0:1789131208.463862:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523456 00000100:00100000:1.0:1789131208.463908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1789131208.463916:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893523456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131208.463949:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893523456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131208.463955:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00080000:0.0:1789131208.465175:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131208.465183:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131208.465186:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131208.666654:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910330752:0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.666715:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131208.666764:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131208.666770:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910330880:0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.666792:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131208.666824:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330752 00000100:00100000:2.0:1789131208.666830:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330752 00000100:00100000:2.0:1789131208.666875:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131208.666885:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910330752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.666929:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910330752:12345-0@lo:400:kworker.0 Request processed in 46us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.666937:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131208.666959:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330880 00000100:00100000:2.0:1789131208.666962:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330880 00000100:00100000:2.0:1789131208.666985:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789131208.666991:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910330880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.667019:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910330880:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.667025:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789131208.667039:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131208.667067:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403f840 x1876039910330880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131208.667093:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910330880:0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.667104:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910330752:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.667227:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910330496:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.667270:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131208.667300:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910331008:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.667342:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131208.667358:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789131208.667363:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910330624:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.667393:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131208.667406:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43decb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910331136:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.667432:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131208.667787:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330496 00000100:00100000:2.0:1789131208.667792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330496 00000100:00100000:2.0:1789131208.667824:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789131208.667831:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910330496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.667875:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910330496:12345-0@lo:400:kworker.0 Request processed in 44us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.667881:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1789131208.667905:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331008 00000100:00100000:2.0:1789131208.667908:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331008 00000100:00100000:2.0:1789131208.667935:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910330624 00000100:00100000:2.0:1789131208.667937:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910330624 00000100:00100000:2.0:1789131208.667951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789131208.667956:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910331008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.667985:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910331008:12345-0@lo:400:kworker.0 Request processed in 29us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.667991:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789131208.668001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789131208.668007:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910330624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.668028:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910330624:12345-0@lo:400:kworker.0 Request processed in 22us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.668034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789131208.668051:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331136 00000100:00100000:2.0:1789131208.668054:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331136 00000100:00100000:2.0:1789131208.668083:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131208.668088:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910331136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131208.668115:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910331136:12345-0@lo:400:kworker.0 Request processed in 27us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131208.668121:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789131208.668137:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131208.668140:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131208.668316:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910330624:0@lo:400:kworker.0 00010000:00080000:0.0:1789131208.668353:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43decb40 x1876039910331136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131208.668363:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43decb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910331136:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.668380:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910330496:0@lo:400:kworker.0 00000100:00100000:0.0:1789131208.668390:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910331008:0@lo:400:kworker.0 00000100:00100000:2.0:1789131209.179559:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910331264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131209.179643:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131209.180070:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331264 00000100:00100000:1.0:1789131209.180088:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331264 00000100:00100000:1.0:1789131209.180143:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789131209.180155:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910331264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131209.180195:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131209.180266:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910331264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131209.180276:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789131209.180285:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea61c0 x1876039910331264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131209.180307:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910331264:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131209.306907:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131210.332791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131211.247939:0:9072:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing yml_node 00010000:00010000:2.0:1789131211.355494:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131212.249740:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131212.255552:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43dec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910331392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131212.255620:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131212.255706:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331392 00000100:00100000:1.0:1789131212.255714:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331392 00000100:00100000:1.0:1789131212.255771:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131212.255781:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910331392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131212.255814:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131212.255860:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910331392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131212.255879:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789131212.255920:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43dec780 x1876039910331392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131212.255939:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43dec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910331392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131212.255990:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131212.378539:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131213.401539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131213.573955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131213.574008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131213.574144:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524096 00000100:00100000:3.0:1789131213.574155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524096 00000100:00100000:2.0:1789131213.574271:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893523968 00000100:00100000:2.0:1789131213.574276:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893523968 00000100:00100000:2.0:1789131213.574345:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:3.0:1789131213.574349:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1789131213.574356:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893523968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131213.574373:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893524096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131213.574436:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893524096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131213.574443:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00080000:0.0:1789131213.578384:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131213.578806:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893523968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4443us (4853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131213.578819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:1.0:1789131213.584416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131213.584468:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131213.584652:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524224 00000100:00100000:3.0:1789131213.584662:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524224 00000100:00100000:3.0:1789131213.584736:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524352 00000100:00100000:3.0:1789131213.584740:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524352 00000100:00100000:3.0:1789131213.584781:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131213.584795:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2351:x1876039893524224:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1789131213.584831:0:8327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790444f 00000100:00100000:1.0:1789131213.584929:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131213.584938:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2351:x1876039893524352:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:1.0:1789131213.584958:0:6705:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904456 00000100:00080000:1.0:1789131213.584968:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e71000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131213.585004:0:6705:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789131213.585385:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+2:2351:x1876039893524352:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 447us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131213.585394:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00010000:00010000:1.0:1789131213.585418:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131213.585965:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cfb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789131213.586002:0:8327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789131213.586542:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+2:2351:x1876039893524224:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 1750us (2133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131213.586552:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:0.0:1789131213.587408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131213.587417:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789131213.587514:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131213.786880:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910331904:0@lo:400:kworker.0 00000100:00100000:1.0:1789131213.786960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131213.787248:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910331648:0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.787283:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131213.787380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910331520:0@lo:400:kworker.0 00000100:00100000:0.0:1789131213.787495:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131213.787543:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331904 00000100:00100000:0.0:1789131213.787550:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331904 00000100:00100000:0.0:1789131213.787593:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789131213.787602:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910331904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131213.787649:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910331904:12345-0@lo:400:kworker.0 Request processed in 48us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131213.787656:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789131213.787684:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331520 00000100:00100000:0.0:1789131213.787688:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331520 00010000:00080000:1.0:1789131213.787778:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e90b40 x1876039910331904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131213.787791:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910331904:0@lo:400:kworker.0 00000100:00100000:1.0:1789131213.787812:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131213.787830:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910331776:0@lo:400:kworker.0 00000100:00100000:1.0:1789131213.787861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131213.787872:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910332160:0@lo:400:kworker.0 00000100:00100000:3.0:1789131213.787909:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131213.793672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331648 00000100:00100000:2.0:1789131213.793688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331648 00000100:00100000:2.0:1789131213.793905:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910331776 00000100:00100000:2.0:1789131213.793910:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910331776 00000100:00100000:2.0:1789131213.794034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789131213.794044:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910331648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.794136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910331648:12345-0@lo:400:kworker.0 Request processed in 94us (6852us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131213.794143:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789131213.794158:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789131213.794164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910331776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.794215:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910331776:12345-0@lo:400:kworker.0 Request processed in 41us (6344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131213.794222:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789131213.794249:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131213.794991:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789131213.795263:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910331520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131213.795339:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910331520:12345-0@lo:400:kworker.0 Request processed in 306us (7826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131213.795347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789131213.797133:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910331648:0@lo:400:kworker.0 00000100:00100000:3.0:1789131213.797199:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332160 00000100:00100000:3.0:1789131213.797215:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332160 00000100:00100000:3.0:1789131213.797275:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789131213.797288:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910332160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131213.797378:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910332160:12345-0@lo:400:kworker.0 Request processed in 95us (9468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131213.797384:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789131213.797432:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa59680 x1876039910332160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131213.797444:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910332160:0@lo:400:kworker.0 00000100:00080000:3.0:1789131213.797468:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131213.798365:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910331776:0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.803119:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910331520:0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.803137:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910332032:0@lo:400:kworker.0 00000100:00100000:2.0:1789131213.803218:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131213.804129:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332032 00000100:00100000:3.0:1789131213.804138:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332032 00000100:00100000:3.0:1789131213.804231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789131213.804242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910332032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131213.804311:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910332032:12345-0@lo:400:kworker.0 Request processed in 71us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131213.804318:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789131213.806056:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131213.806118:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910332032:0@lo:400:kworker.0 00000100:00100000:0.0:1789131214.301002:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910332288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131214.301151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131214.302581:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332288 00000100:00100000:1.0:1789131214.302595:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332288 00000100:00100000:1.0:1789131214.302646:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131214.302655:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910332288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131214.302692:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131214.302755:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910332288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131214.302762:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789131214.303486:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa58f00 x1876039910332288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131230 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131214.303510:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910332288:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789131214.425615:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789131214.870892:0:9264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.132 00010000:00010000:2.0:1789131215.453243:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789131216.397923:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:1.0:1789131216.397932:0:7662:0:(genops.c:885:class_export_put()) final put ffff9c0c81e74000/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:2.0:1789131216.398475:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c81e74000/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-OST0001 00000020:00000080:2.0:1789131216.398527:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c81e71000 for lustre-OST0001 00010000:00010000:2.0:1789131216.473547:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131217.296537:0:9363:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.132 00000100:00100000:3.0:1789131217.371682:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910332416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131217.371750:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131217.371820:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332416 00000100:00100000:3.0:1789131217.371827:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332416 00000100:00100000:3.0:1789131217.371875:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789131217.371887:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910332416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131217.371916:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131217.371958:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910332416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131217.371966:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789131217.371994:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131217.372034:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c4000 x1876039910332416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131217.372052:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910332416:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789131217.420610:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:0.0:1789131217.420620:0:6729:0:(genops.c:885:class_export_put()) final put ffff9c0b41cfd000/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:2.0:1789131217.420683:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41cfd000/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-OST0000 00000020:00000080:2.0:1789131217.420736:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b41cfb000 for lustre-OST0000 00010000:00010000:2.0:1789131217.497818:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131218.523511:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131218.691952:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131218.691995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131218.692062:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524608 00000100:00100000:3.0:1789131218.692072:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524608 00000100:00100000:2.0:1789131218.692191:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524480 00000100:00100000:2.0:1789131218.692195:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524480 00000100:00100000:2.0:1789131218.692234:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:3.0:1789131218.692237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1789131218.692245:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893524480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131218.692254:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893524608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131218.692315:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893524480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131218.692352:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:2.0:1789131218.692697:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa592c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893524608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 450us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131218.692705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00080000:0.0:1789131218.693779:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131218.906960:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43decf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910332544:0@lo:400:kworker.0 00000100:00100000:1.0:1789131218.907077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910332800:0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907101:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131218.907135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131218.907181:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131218.907183:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910333056:0@lo:400:kworker.0 00000100:00100000:1.0:1789131218.907191:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910332928:0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907227:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131218.907232:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131218.907263:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789131218.907270:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43deda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910332672:0@lo:400:kworker.0 00000100:00100000:1.0:1789131218.907279:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332800 00000100:00100000:1.0:1789131218.907288:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332800 00000100:00100000:0.0:1789131218.907295:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131218.907318:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43def0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910333184:0@lo:400:kworker.0 00000100:00100000:1.0:1789131218.907362:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333056 00000100:00100000:1.0:1789131218.907367:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333056 00000100:00100000:0.0:1789131218.907385:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131218.907391:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332672 00000100:00100000:1.0:1789131218.907394:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332672 00000100:00100000:1.0:1789131218.907417:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131218.907429:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789131218.907430:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910332800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907440:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910333056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131218.907522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332544 00000100:00100000:2.0:1789131218.907527:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332544 00000100:00100000:3.0:1789131218.907552:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789131218.907554:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789131218.907560:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:2.0:1789131218.907560:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910332544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131218.907654:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789131218.907674:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910332672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907681:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910333056:12345-0@lo:400:kworker.0 Request processed in 245us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131218.907688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789131218.907706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910332672:12345-0@lo:400:kworker.0 Request processed in 35us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131218.907711:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910332928 00000100:00100000:3.0:1789131218.907712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789131218.907714:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910332928 00000100:00100000:0.0:1789131218.907737:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333184 00000100:00100000:0.0:1789131218.907740:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333184 00000100:00100000:0.0:1789131218.907759:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789131218.907764:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910332928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907805:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910332928:12345-0@lo:400:kworker.0 Request processed in 40us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131218.907811:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789131218.907826:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131218.907832:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910333184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.907873:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910333184:12345-0@lo:400:kworker.0 Request processed in 41us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131218.907878:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789131218.907952:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43defc00 x1876039910332928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131218.907965:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910332928:0@lo:400:kworker.0 00000100:00080000:0.0:1789131218.907997:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131218.908002:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131218.908021:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43deda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910332672:0@lo:400:kworker.0 00010000:00080000:0.0:1789131218.908031:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43def0c0 x1876039910333184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131218.908038:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43def0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910333184:0@lo:400:kworker.0 00000100:00100000:0.0:1789131218.908055:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910333056:0@lo:400:kworker.0 00000100:00100000:1.0:1789131218.917455:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910332800:12345-0@lo:400:kworker.0 Request processed in 10021us (10311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131218.917470:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131218.918152:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910332800:0@lo:400:kworker.0 00000100:00100000:2.0:1789131218.919016:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910332544:12345-0@lo:400:kworker.0 Request processed in 11450us (11911us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131218.919028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789131218.919212:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43decf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910332544:0@lo:400:kworker.0 00000100:00100000:1.0:1789131219.418888:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131219.418910:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910333312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131219.418978:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131219.419044:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333312 00000100:00100000:1.0:1789131219.419052:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333312 00000100:00100000:1.0:1789131219.419097:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131219.419106:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910333312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131219.419139:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131219.419192:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910333312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131219.419199:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1789131219.419254:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa5b0c0 x1876039910333312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131219.419272:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910333312:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131219.547155:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131219.889568:0:9462:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.132 00010000:00010000:2.0:1789131220.569664:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131221.593500:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789131221.754776:0:9511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 08:53:40 EDT 2026 00000100:00100000:0.0:1789131222.491750:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131222.491784:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910333440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131222.491886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131222.492100:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333440 00000100:00100000:1.0:1789131222.492116:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333440 00000100:00100000:1.0:1789131222.492201:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789131222.492211:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910333440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131222.492246:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131222.492346:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910333440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131222.492353:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1789131222.492378:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131222.492555:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbe940 x1876039910333440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131238 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131222.492575:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910333440:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789131222.617604:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131223.641633:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131223.814965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131223.815474:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131223.816404:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524864 00000100:00100000:0.0:1789131223.816415:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524864 00000100:00100000:0.0:1789131223.816489:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1789131223.816500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893524864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131223.816568:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893524864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131223.816575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00080000:1.0:1789131223.816638:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131223.817305:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524736 00000100:00100000:2.0:1789131223.817312:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524736 00000100:00100000:3.0:1789131223.817624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1789131223.817638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893524736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131223.817791:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2352:x1876039893524736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 157us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131223.817799:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:1.0:1789131224.025596:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910333952:0@lo:400:kworker.0 00000100:00100000:3.0:1789131224.025607:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910333696:0@lo:400:kworker.0 00000100:00100000:3.0:1789131224.025672:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131224.025672:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131224.025733:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131224.025739:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910333824:0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.025773:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333952 00000100:00100000:1.0:1789131224.025779:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333952 00000100:00100000:1.0:1789131224.025835:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789131224.025841:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910334208:0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.025848:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910333952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131224.025874:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131224.025908:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910333952:12345-0@lo:400:kworker.0 Request processed in 64us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131224.025913:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789131224.025921:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910333568:0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.025928:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789131224.025946:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334208 00000100:00100000:1.0:1789131224.025951:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334208 00000100:00100000:3.0:1789131224.025958:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131224.025978:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789131224.025987:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910334208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131224.026003:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910334080:0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.026024:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910334208:12345-0@lo:400:kworker.0 Request processed in 38us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131224.026032:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789131224.026049:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131224.026052:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131224.026107:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789131224.026159:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa5b0c0 x1876039910334208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131224.026173:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910334208:0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.026226:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333696 00000100:00100000:1.0:1789131224.026230:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333696 00000100:00100000:1.0:1789131224.026267:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334080 00000100:00100000:1.0:1789131224.026270:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334080 00000100:00100000:1.0:1789131224.026295:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789131224.026301:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910333696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.026363:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910333696:12345-0@lo:400:kworker.0 Request processed in 62us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131224.026368:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789131224.026380:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789131224.026386:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131224.026413:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910334080:12345-0@lo:400:kworker.0 Request processed in 28us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131224.026418:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1789131224.026435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131224.026532:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910334080:0@lo:400:kworker.0 00000100:00100000:2.0:1789131224.026536:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333568 00000100:00100000:2.0:1789131224.026541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333568 00000100:00100000:3.0:1789131224.026546:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910333696:0@lo:400:kworker.0 00000100:00100000:2.0:1789131224.026586:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789131224.026591:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131224.026599:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910333568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131224.026647:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910333568:12345-0@lo:400:kworker.0 Request processed in 51us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131224.026653:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1789131224.026695:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910333568:0@lo:400:kworker.0 00010000:00080000:3.0:1789131224.026935:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa5a940 x1876039910333952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131224.026946:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910333952:0@lo:400:kworker.0 00000100:00100000:0.0:1789131224.027195:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910333824 00000100:00100000:0.0:1789131224.027201:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910333824 00000100:00100000:0.0:1789131224.027553:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789131224.027562:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910333824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131224.027615:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910333824:12345-0@lo:400:kworker.0 Request processed in 55us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131224.027636:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789131224.027714:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910333824:0@lo:400:kworker.0 00000100:00080000:1.0:1789131224.028852:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131224.538417:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131224.538441:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131224.538510:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131224.538579:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334336 00000100:00100000:1.0:1789131224.538587:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334336 00000100:00100000:1.0:1789131224.538631:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131224.538640:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131224.538675:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131224.538732:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131224.538739:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1789131224.538777:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa58f00 x1876039910334336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131224.538810:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334336:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131224.665584:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131225.692052:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131226.713693:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131227.613488:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131227.614532:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131227.617194:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334464 00000100:00100000:0.0:1789131227.617212:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334464 00000100:00100000:0.0:1789131227.617277:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789131227.617285:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131227.617346:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131227.617419:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (2890us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131227.617427:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1789131227.617471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789131227.617504:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea5680 x1876039910334464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131227.617523:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334464:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131227.738985:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131228.762452:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131228.932906:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131228.933092:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131228.934840:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525120 00000100:00100000:0.0:1789131228.934852:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525120 00000100:00100000:0.0:1789131228.935070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131228.935080:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893525120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131228.935165:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893525120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 86us (2072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131228.935172:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1789131228.936919:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893524992 00000100:00100000:1.0:1789131228.936939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893524992 00000100:00100000:1.0:1789131228.937002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:1.0:1789131228.937013:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893524992:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131228.937070:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893524992:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (4172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131228.937078:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00080000:2.0:1789131228.938830:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131229.145637:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334976:0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.145706:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131229.145735:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910334720:0@lo:400:kworker.0 00000100:00100000:3.0:1789131229.145768:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131229.145772:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131229.145779:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910334848:0@lo:400:kworker.0 00000100:00100000:3.0:1789131229.145788:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910335232:0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.145801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131229.145827:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131229.145830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334720 00000100:00100000:0.0:1789131229.145836:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334720 00000100:00100000:3.0:1789131229.145849:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789131229.145855:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910334592:0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.145876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334848 00000100:00100000:0.0:1789131229.145879:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334848 00000100:00100000:3.0:1789131229.145881:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131229.145906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131229.145910:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910335104:0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.145914:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910334720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131229.145930:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131229.145955:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335104 00000100:00100000:3.0:1789131229.145964:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335104 00000100:00100000:0.0:1789131229.145968:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910334720:12345-0@lo:400:kworker.0 Request processed in 55us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131229.145976:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131229.145988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789131229.145991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131229.145993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910334848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.145996:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910335104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.146020:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910335104:12345-0@lo:400:kworker.0 Request processed in 24us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131229.146024:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910334848:12345-0@lo:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131229.146027:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131229.146030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131229.146089:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910335104:0@lo:400:kworker.0 00000100:00100000:1.0:1789131229.146091:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334976 00000100:00100000:1.0:1789131229.146103:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334976 00000100:00100000:3.0:1789131229.146110:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910334720:0@lo:400:kworker.0 00000100:00100000:1.0:1789131229.146133:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335232 00000100:00100000:1.0:1789131229.146136:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335232 00000100:00100000:3.0:1789131229.146154:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789131229.146162:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131229.146196:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910334976:12345-0@lo:400:kworker.0 Request processed in 36us (490us total) trans 0 rc 0/0 00000100:00080000:2.0:1789131229.146198:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131229.146202:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131229.146204:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131229.146225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910334592 00000100:00100000:2.0:1789131229.146229:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910334592 00000100:00100000:2.0:1789131229.146255:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789131229.146261:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910334592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131229.146298:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910334592:12345-0@lo:400:kworker.0 Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131229.146304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789131229.146373:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910334592:0@lo:400:kworker.0 00000100:00100000:0.0:1789131229.146448:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910334848:0@lo:400:kworker.0 00010000:00080000:0.0:1789131229.146459:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbe580 x1876039910334976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131229.146468:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910334976:0@lo:400:kworker.0 00000100:00100000:1.0:1789131229.152551:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131229.152579:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910335232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131229.152683:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910335232:12345-0@lo:400:kworker.0 Request processed in 119us (6854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131229.152690:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789131229.156494:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789131229.156683:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbf480 x1876039910335232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131229.156699:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910335232:0@lo:400:kworker.0 00000100:00100000:1.0:1789131229.658869:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131229.658901:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910335360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131229.658996:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131229.659087:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335360 00000100:00100000:1.0:1789131229.659110:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335360 00000100:00100000:1.0:1789131229.659176:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789131229.659187:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910335360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131229.659232:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131229.659303:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910335360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131229.659312:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789131229.659390:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa59a40 x1876039910335360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131229.659411:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910335360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789131229.787721:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131230.811305:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131231.833565:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131232.732090:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910335488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131232.732172:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131232.732245:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335488 00000100:00100000:3.0:1789131232.732253:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335488 00000100:00100000:3.0:1789131232.732303:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789131232.732316:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910335488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131232.732369:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131232.732408:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910335488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131232.732423:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1789131232.732463:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00d680 x1876039910335488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131248 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131232.732481:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910335488:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789131232.736093:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131232.857512:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131233.882183:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131234.056226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131234.056278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131234.056284:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525376 00000100:00100000:2.0:1789131234.056294:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525376 00000100:00100000:2.0:1789131234.056402:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1789131234.056414:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893525376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131234.056488:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893525376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131234.056698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525248 00000100:00100000:3.0:1789131234.056703:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525248 00000100:00100000:3.0:1789131234.056768:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1789131234.056776:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893525248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131234.056805:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893525248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131234.056811:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:2.0:1789131234.056980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00080000:2.0:1789131234.057003:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131234.274099:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910335616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131234.274166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131234.274941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335616 00000100:00100000:0.0:1789131234.274949:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335616 00000100:00100000:0.0:1789131234.274994:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789131234.275003:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910335616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131234.281242:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910335616:12345-0@lo:400:kworker.0 Request processed in 6230us (7066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131234.281257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789131234.281530:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910335616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131234.281556:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131234.281567:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910335744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131234.281616:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131234.281696:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335744 00000100:00100000:0.0:1789131234.281703:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335744 00000100:00100000:0.0:1789131234.281754:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789131234.281763:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910335744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131234.281825:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910335744:12345-0@lo:400:kworker.0 Request processed in 62us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131234.281844:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789131234.282030:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910335744:0@lo:400:kworker.0 00000100:00100000:0.0:1789131234.282357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910335872:0@lo:400:kworker.0 00000100:00100000:0.0:1789131234.282388:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131234.282494:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910335872 00000100:00100000:3.0:1789131234.282499:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910335872 00000100:00100000:3.0:1789131234.282588:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789131234.282597:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910335872:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789131234.282664:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131234.282785:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336000:0@lo:400:kworker.0 00000100:00100000:2.0:1789131234.282817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131234.282920:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910336256:0@lo:400:kworker.0 00000100:00100000:1.0:1789131234.282949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131234.282971:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131234.282977:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910336128:0@lo:400:kworker.0 00000100:00100000:1.0:1789131234.282998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131234.283021:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336128 00000100:00100000:1.0:1789131234.283025:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336128 00000100:00100000:1.0:1789131234.283057:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789131234.283076:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910336128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131234.283111:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910336128:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131234.283118:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789131234.283138:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336000 00000100:00100000:1.0:1789131234.283142:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336000 00000100:00100000:1.0:1789131234.283165:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336256 00000100:00100000:1.0:1789131234.283168:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336256 00000100:00100000:1.0:1789131234.283202:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131234.283208:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131234.283344:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910335872:12345-0@lo:400:kworker.0 Request processed in 749us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131234.283351:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789131234.283485:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336000:12345-0@lo:400:kworker.0 Request processed in 276us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131234.283492:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131234.283506:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131234.283513:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910336256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131234.283544:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910336256:12345-0@lo:400:kworker.0 Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131234.283550:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131234.283580:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910336128:0@lo:400:kworker.0 00010000:00080000:1.0:1789131234.283593:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa59a40 x1876039910336256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131234.283603:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa59a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910336256:0@lo:400:kworker.0 00000100:00100000:0.0:1789131234.283794:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910335872:0@lo:400:kworker.0 00000100:00080000:3.0:1789131234.288383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131234.288391:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131234.288395:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131234.289789:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa58780 x1876039910336000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131234.289807:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336000:0@lo:400:kworker.0 00000100:00100000:3.0:1789131234.778288:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131234.778314:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131234.778400:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131234.778627:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336384 00000100:00100000:1.0:1789131234.778635:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336384 00000100:00100000:1.0:1789131234.778689:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131234.778699:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131234.778733:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131234.778783:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131234.778790:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1789131234.778801:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43dee1c0 x1876039910336384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131250 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131234.778820:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336384:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131234.905518:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131235.929785:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789131236.431548:0:10143:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 08:53:55 (1789131235) === 00000100:00100000:1.0:1789131236.868236:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131236.868350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525504 00000100:00100000:3.0:1789131236.868358:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525504 00000100:00100000:3.0:1789131236.868462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:3.0:1789131236.868474:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:8120:x1876039893525504:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131236.868490:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131236.868507:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8e00/0x9f0de3718790451a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039535 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.868533:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8e00/0x9f0de3718790451a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039535 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.868543:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8e00/0x9f0de3718790451a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039535 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.868552:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8e00, rc 0) 00000100:00100000:3.0:1789131236.868608:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893525504:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 136us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131236.868615:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:2.0:1789131236.877303:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.877419:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525632 00000100:00100000:0.0:1789131236.877430:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525632 00000100:00100000:0.0:1789131236.877486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:0.0:1789131236.877496:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893525632:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789131236.877785:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893525632:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 289us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.877794:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:1.0:1789131236.883924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131236.884009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525760 00000100:00100000:3.0:1789131236.884019:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525760 00000100:00100000:3.0:1789131236.884085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:3.0:1789131236.884095:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893525760:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789131236.884422:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893525760:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 227us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131236.884441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:2.0:1789131236.895227:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131236.895404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893525888 00000100:00100000:1.0:1789131236.895413:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893525888 00000100:00100000:1.0:1789131236.895469:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1789131236.895479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8124:x1876039893525888:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131236.895835:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8124:x1876039893525888:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 355us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131236.895843:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:2.0:1789131236.924480:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.925433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526016 00000100:00100000:0.0:1789131236.925443:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526016 00000100:00100000:0.0:1789131236.925544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:0.0:1789131236.925553:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8124:x1876039893526016:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131236.925856:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8124:x1876039893526016:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 294us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.925872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:0.0:1789131236.933930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131236.934569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526144 00000100:00100000:3.0:1789131236.934596:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526144 00000100:00100000:3.0:1789131236.934655:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1789131236.934665:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:8120:x1876039893526144:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131236.934682:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131236.934697:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c414b8c00/0x9f0de37187904521 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03955f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.934723:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c414b8c00/0x9f0de37187904521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03955f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.934734:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c414b8c00/0x9f0de37187904521 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03955f expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131236.934743:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414b8c00, rc 0) 00000100:00100000:3.0:1789131236.934807:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:8120:x1876039893526144:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 143us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131236.934815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:2.0:1789131236.939414:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.939577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526272 00000100:00100000:0.0:1789131236.939588:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526272 00000100:00100000:0.0:1789131236.939640:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:0.0:1789131236.939650:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:8120:x1876039893526272:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789131236.939677:0:5838:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789131236.939698:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789131236.939702:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789131236.939706:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789131236.939708:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789131236.945286:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:8120:x1876039893526272:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 5625us (5965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131236.945299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00010000:00010000:2.0:1789131236.953598:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131236.955740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.956132:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526400 00000100:00100000:0.0:1789131236.956273:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526400 00000100:00100000:0.0:1789131236.956463:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:0.0:1789131236.956474:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:8120:x1876039893526400:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789131236.956491:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131236.956508:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039566 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131236.956536:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131236.956548:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131236.956557:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14600, rc 0) 00000100:00100000:0.0:1789131236.956625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8120:x1876039893526400:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 153us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.956633:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1789131236.959305:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131236.959440:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526528 00000100:00100000:1.0:1789131236.959450:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526528 00000100:00100000:1.0:1789131236.959536:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:1.0:1789131236.959545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8120:x1876039893526528:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789131236.959828:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8120:x1876039893526528:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 283us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131236.959836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:2.0:1789131236.963633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.963875:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526656 00000100:00100000:0.0:1789131236.963885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526656 00000100:00100000:0.0:1789131236.964136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:0.0:1789131236.964264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8120:x1876039893526656:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789131236.964584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8120:x1876039893526656:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 434us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.964603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:0.0:1789131236.969437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131236.969657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526784 00000100:00100000:1.0:1789131236.969666:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526784 00000100:00100000:1.0:1789131236.969730:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:1.0:1789131236.969739:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8129:x1876039893526784:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131236.970076:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8129:x1876039893526784:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 336us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131236.970095:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:2.0:1789131236.973614:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.974058:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893526912 00000100:00100000:0.0:1789131236.974069:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893526912 00000100:00100000:0.0:1789131236.974126:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:0.0:1789131236.974136:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8129:x1876039893526912:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131236.975355:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:8129:x1876039893526912:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 1215us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.975367:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:2.0:1789131236.986404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131236.986438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131236.991371:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527040 00000100:00100000:0.0:1789131236.991387:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527040 00000100:00100000:0.0:1789131236.991440:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527168 00000100:00100000:0.0:1789131236.991444:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527168 00000100:00100000:0.0:1789131236.991508:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1789131236.991519:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893527168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131236.991612:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893527168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (5173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.991619:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1789131236.991638:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1789131236.991642:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1876039893527040:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789131236.991664:0:8131:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from ea032118-1b0a-4f07-916a-9ad64f96010c@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:0.0:1789131236.991697:0:8131:0:(genops.c:1385:class_connect()) connect: client ea032118-1b0a-4f07-916a-9ad64f96010c, cookie 0x9f0de3718790452f 00000004:00100000:0.0:1789131236.991724:0:8131:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789131236.992276:0:8131:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a79c000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131236.992364:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2351:x1876039893527040:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 719us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131236.992372:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:2.0:1789131236.993074:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131236.999475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131236.999567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131236.999778:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527296 00000100:00100000:3.0:1789131236.999788:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527296 00000100:00100000:3.0:1789131236.999865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527424 00000100:00100000:3.0:1789131236.999869:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527424 00000100:00100000:3.0:1789131236.999893:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1789131236.999902:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+7:0:x1876039893527296:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789131236.999955:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1789131237.000156:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131237.000277:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1789131237.000287:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+7:8120:x1876039893527424:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789131237.000302:0:8131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789131237.000350:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+7:8120:x1876039893527424:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 65us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131237.000357:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1789131237.004607:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+6:0:x1876039893527296:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 131us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131237.004895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1789131237.008314:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131237.012432:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527552 00000100:00100000:3.0:1789131237.012994:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527552 00000100:00100000:2.0:1789131237.013187:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1789131237.013198:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+6:8120:x1876039893527552:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789131237.013294:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+6:8120:x1876039893527552:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 98us (4989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131237.013302:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1789131237.019130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131237.019179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131237.019220:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131237.019379:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527680 00000100:00100000:0.0:1789131237.019389:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527680 00000100:00100000:0.0:1789131237.019431:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527808 00000100:00100000:0.0:1789131237.019435:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527808 00000100:00100000:0.0:1789131237.019452:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1789131237.019461:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876039893527680:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789131237.019492:0:8327:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from ea032118-1b0a-4f07-916a-9ad64f96010c@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:0.0:1789131237.019523:0:8327:0:(genops.c:1385:class_connect()) connect: client ea032118-1b0a-4f07-916a-9ad64f96010c, cookie 0x9f0de37187904536 00002000:00100000:0.0:1789131237.019535:0:8327:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ea032118-1b0a-4f07-916a-9ad64f96010c/ffff9c0c7a798000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789131237.019558:0:8327:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789131237.019788:0:8327:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789131237.019818:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a799000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131237.019881:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2351:x1876039893527680:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 419us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131237.019889:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1789131237.019905:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1789131237.019935:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876039893527808:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789131237.019952:0:8327:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from ea032118-1b0a-4f07-916a-9ad64f96010c@192.168.203.52@tcp t0 exp 0000000000000000 cur 248 last 0 00000020:00000080:0.0:1789131237.019970:0:8327:0:(genops.c:1385:class_connect()) connect: client ea032118-1b0a-4f07-916a-9ad64f96010c, cookie 0x9f0de3718790453d 00002000:00100000:0.0:1789131237.019975:0:8327:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ea032118-1b0a-4f07-916a-9ad64f96010c/ffff9c0c7a79d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789131237.019990:0:8327:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789131237.020131:0:8327:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:3.0:1789131237.020290:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893527936 00000100:00100000:3.0:1789131237.020297:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893527936 00000100:00100000:3.0:1789131237.020365:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1789131237.020375:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+6:8120:x1876039893527936:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789131237.020611:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1789131237.020730:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+6:8120:x1876039893527936:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 356us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131237.020736:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00080000:0.0:1789131237.020828:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a79e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131237.020855:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2351:x1876039893527808:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 932us (1676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131237.020863:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1789131237.852767:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131237.852838:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131237.852961:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336512 00000100:00100000:2.0:1789131237.852970:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336512 00000100:00100000:2.0:1789131237.853019:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131237.853028:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789131237.853063:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131237.853118:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910336512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131237.853126:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789131237.853154:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789131237.853181:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbcb40 x1876039910336512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131237.853199:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910336512:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1789131237.912252:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00000001:00100000:0.0:1789131237.916075:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00010000:00010000:2.0:1789131237.979761:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131239.001534:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131239.388194:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910336640:0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.388260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131239.388311:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131239.388317:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910336768:0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.388357:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131239.390215:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336640 00000100:00100000:3.0:1789131239.390223:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336640 00000100:00100000:3.0:1789131239.390277:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789131239.390287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910336640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.390699:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910337152:0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.391090:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910337280:0@lo:400:kworker.0 00000100:00100000:2.0:1789131239.391149:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910336896:0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.391692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131239.391741:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910336640:0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.391821:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131239.391870:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336768 00000100:00100000:1.0:1789131239.391876:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336768 00000100:00100000:1.0:1789131239.391911:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337152 00000100:00100000:1.0:1789131239.391914:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337152 00000100:00100000:1.0:1789131239.391943:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789131239.391953:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910336768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.392060:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910336768:12345-0@lo:400:kworker.0 Request processed in 107us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131239.392068:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789131239.392086:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131239.392092:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910337152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.392123:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910337152:12345-0@lo:400:kworker.0 Request processed in 32us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131239.392130:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1789131239.392156:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131239.392292:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910337152:0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.392302:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910336768:0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.393045:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337280 00000100:00100000:0.0:1789131239.393053:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337280 00000100:00100000:0.0:1789131239.393105:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131239.393112:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910337280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.393160:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910337280:12345-0@lo:400:kworker.0 Request processed in 48us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131239.393179:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1789131239.393239:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789131239.393267:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00e1c0 x1876039910337280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131239.393294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910337280:0@lo:400:kworker.0 00000100:00100000:3.0:1789131239.397709:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910336640:12345-0@lo:400:kworker.0 Request processed in 7414us (9438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131239.397725:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789131239.399699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131239.399793:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131239.399804:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910337024:0@lo:400:kworker.0 00000100:00100000:2.0:1789131239.399847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131239.400130:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337024 00000100:00100000:1.0:1789131239.400138:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337024 00000100:00100000:1.0:1789131239.400194:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789131239.400203:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910337024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131239.400255:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910337024:12345-0@lo:400:kworker.0 Request processed in 52us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131239.400262:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789131239.400315:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789131239.400384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00d2c0 x1876039910337024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131255 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131239.400399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910337024:0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.402176:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910336896 00000100:00100000:0.0:1789131239.402188:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910336896 00000100:00100000:0.0:1789131239.402250:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789131239.402259:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910336896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131239.402351:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910336896:12345-0@lo:400:kworker.0 Request processed in 93us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131239.402358:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789131239.402477:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131239.403291:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910336896:0@lo:400:kworker.0 00000100:00100000:3.0:1789131239.905792:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910337408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131239.905857:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131239.906402:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337408 00000100:00100000:2.0:1789131239.906411:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337408 00000100:00100000:2.0:1789131239.906463:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131239.906473:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910337408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131239.906509:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131239.908450:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910337408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1970us (2582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131239.908463:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789131239.908791:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684a1c0 x1876039910337408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131255 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131239.908814:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910337408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131240.025467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131241.049704:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789131241.999287:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00010000:00010000:1.0:1789131242.074670:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131242.244722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131242.244759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131242.244783:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131242.244820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528320 00000100:00100000:3.0:1789131242.244829:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528320 00000100:00100000:3.0:1789131242.244888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1789131242.244901:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528320:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131242.244967:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528320:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131242.244974:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00080000:3.0:1789131242.244992:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131242.245118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528064 00000100:00100000:2.0:1789131242.245122:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528064 00000100:00100000:2.0:1789131242.245155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:2.0:1789131242.245161:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893528064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131242.249957:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893528064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4782us (5231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131242.249971:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:1.0:1789131242.250121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131242.250168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131242.250196:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528576 00000100:00100000:1.0:1789131242.250204:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528576 00000100:00100000:1.0:1789131242.250525:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528448 00000100:00100000:1.0:1789131242.250529:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528448 00000100:00100000:1.0:1789131242.250553:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131242.250564:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528576:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131242.250743:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528576:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 179us (5956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131242.250751:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131242.250767:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:1.0:1789131242.250774:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528448:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131242.250810:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528448:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131242.250816:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1789131242.252354:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528192 00000100:00100000:2.0:1789131242.252363:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528192 00000100:00100000:2.0:1789131242.252420:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1789131242.252430:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893528192:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131242.252480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893528192:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131242.252486:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00080000:2.0:1789131242.253432:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789131242.253439:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131242.253442:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1789131242.319850:0:10339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1789131242.973708:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910337536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131242.973776:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131242.973837:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337536 00000100:00100000:1.0:1789131242.973844:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337536 00000100:00080000:0.0:1789131242.975248:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131242.978241:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789131242.978265:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910337536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131242.978314:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131242.978413:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910337536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (4637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131242.978420:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789131242.978516:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7437e940 x1876039910337536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131242.978547:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910337536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789131243.099582:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131244.121887:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131244.505883:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910337792:0@lo:400:kworker.0 00000100:00100000:3.0:1789131244.505950:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131244.506174:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910337664:0@lo:400:kworker.0 00000100:00100000:1.0:1789131244.506206:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131244.506357:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910337920:0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131244.506409:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910338048:0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131244.506462:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338048 00000100:00100000:0.0:1789131244.506469:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338048 00000100:00100000:0.0:1789131244.506524:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131244.506534:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910338048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506583:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910338048:12345-0@lo:400:kworker.0 Request processed in 50us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131244.506590:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1789131244.506609:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131244.506634:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337792 00000100:00100000:0.0:1789131244.506646:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337792 00000100:00100000:0.0:1789131244.506668:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337920 00000100:00100000:0.0:1789131244.506670:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337920 00000100:00100000:0.0:1789131244.506687:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789131244.506692:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910337792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506720:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910337792:12345-0@lo:400:kworker.0 Request processed in 27us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131244.506725:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789131244.506734:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789131244.506739:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506760:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910337920:12345-0@lo:400:kworker.0 Request processed in 21us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131244.506766:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789131244.506779:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131244.506794:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910337664 00000100:00100000:0.0:1789131244.506796:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910337664 00000100:00100000:0.0:1789131244.506815:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1789131244.506820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910337664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.506851:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910337664:12345-0@lo:400:kworker.0 Request processed in 30us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131244.506857:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789131244.507787:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910337792:0@lo:400:kworker.0 00000100:00100000:3.0:1789131244.507804:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910338304:0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.508576:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910337664:0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.508585:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910338176:0@lo:400:kworker.0 00000100:00100000:0.0:1789131244.508624:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131244.508724:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910337920:0@lo:400:kworker.0 00000100:00100000:2.0:1789131244.508805:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338176 00000100:00100000:2.0:1789131244.509060:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338176 00000100:00080000:1.0:1789131244.509166:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131244.509229:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789131244.509239:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910338176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131244.509288:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910338176:12345-0@lo:400:kworker.0 Request processed in 51us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131244.509295:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789131244.509343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910338176:0@lo:400:kworker.0 00000100:00100000:3.0:1789131244.510700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131244.510771:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338304 00000100:00100000:3.0:1789131244.510777:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338304 00000100:00100000:3.0:1789131244.510831:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789131244.510843:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910338304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131244.510886:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910338304:12345-0@lo:400:kworker.0 Request processed in 48us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131244.510893:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789131244.510916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789131244.510958:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00e1c0 x1876039910338304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131244.510970:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910338304:0@lo:400:kworker.0 00010000:00080000:0.0:1789131244.511178:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00c3c0 x1876039910338048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131244.511202:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910338048:0@lo:400:kworker.0 00000100:00100000:3.0:1789131245.018216:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131245.018240:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910338432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131245.018307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131245.018383:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338432 00000100:00100000:3.0:1789131245.018389:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338432 00000100:00100000:3.0:1789131245.018433:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789131245.018441:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910338432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131245.018474:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131245.018514:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910338432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131245.018520:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789131245.018560:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00e1c0 x1876039910338432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131245.018578:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910338432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789131245.145599:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131246.169940:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131247.194848:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131247.362836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131247.362917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131247.362948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131247.362979:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131247.368756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131247.368808:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529088 00000100:00100000:1.0:1789131247.368817:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529088 00000100:00100000:1.0:1789131247.369073:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529216 00000100:00100000:1.0:1789131247.369077:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529216 00000100:00100000:1.0:1789131247.369104:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1789131247.369114:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893529088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131247.369247:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893529088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 133us (6329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131247.369254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1789131247.369272:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1789131247.369282:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893529216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131247.369311:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893529216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131247.369318:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1789131247.369359:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528704 00000100:00100000:1.0:1789131247.369362:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528704 00000100:00100000:1.0:1789131247.369389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:1.0:1789131247.369397:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893528704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131247.369425:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893528704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (6475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131247.369431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00080000:2.0:1789131247.374416:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131247.374426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131247.376199:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528832 00000100:00100000:1.0:1789131247.376200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893528960 00000100:00100000:3.0:1789131247.376214:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528832 00000100:00100000:1.0:1789131247.376215:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893528960 00000100:00080000:2.0:1789131247.376363:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131247.376374:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1789131247.376390:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893528832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131247.376463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893528832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (13637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131247.376471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1789131247.376569:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1789131247.376579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131247.376619:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893528960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (13641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131247.376625:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00080000:2.0:1789131247.378499:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131248.089626:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131248.089650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910338560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131248.089724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131248.089801:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338560 00000100:00100000:2.0:1789131248.089808:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338560 00000100:00080000:1.0:1789131248.089851:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131248.089871:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789131248.089878:0:6708:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789131248.089885:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910338560:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131248.089891:0:6708:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:2.0:1789131248.089923:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131248.089987:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910338560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131248.089994:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789131248.090285:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbe580 x1876039910338560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131248.090303:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910338560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131248.218646:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131249.241682:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131249.626833:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910338688:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.626938:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627015:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910339200:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.627048:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627084:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789131249.627090:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910338816:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.627114:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627134:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910339328:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.627172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910338944:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.627241:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627268:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131249.627273:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910339072:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.627295:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131249.627361:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339200 00000100:00100000:2.0:1789131249.627369:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339200 00000100:00100000:3.0:1789131249.627623:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338816 00000100:00100000:3.0:1789131249.627628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338816 00000100:00100000:3.0:1789131249.627665:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338944 00000100:00100000:3.0:1789131249.627667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338944 00000100:00100000:3.0:1789131249.627757:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131249.627769:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910338816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131249.627832:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910338816:12345-0@lo:400:kworker.0 Request processed in 66us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131249.627840:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131249.627859:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789131249.627865:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910338944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131249.627890:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910338944:12345-0@lo:400:kworker.0 Request processed in 25us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131249.627896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789131249.629083:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789131249.629102:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910339200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.629174:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910339200:12345-0@lo:400:kworker.0 Request processed in 79us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131249.629182:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789131249.629227:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339328 00000100:00100000:2.0:1789131249.629234:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339328 00000100:00100000:2.0:1789131249.629278:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339072 00000100:00100000:2.0:1789131249.629281:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339072 00000100:00100000:2.0:1789131249.629310:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789131249.629317:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910339328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131249.629391:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789131249.629402:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910339072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131249.629444:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910339072:12345-0@lo:400:kworker.0 Request processed in 46us (2148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131249.629450:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789131249.630707:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910339328:12345-0@lo:400:kworker.0 Request processed in 1386us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131249.630718:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789131249.630787:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131249.630794:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131249.630841:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403f840 x1876039910339072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131249.630860:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910339072:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.630888:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910338944:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.630971:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910338816:0@lo:400:kworker.0 00010000:00080000:2.0:1789131249.630985:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67de00 x1876039910339328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131265 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131249.630996:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910339328:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.631011:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910339200:0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.631101:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910338688 00000100:00100000:2.0:1789131249.631109:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910338688 00000100:00100000:2.0:1789131249.631157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789131249.631167:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910338688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131249.631207:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910338688:12345-0@lo:400:kworker.0 Request processed in 42us (4270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131249.631214:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789131249.631417:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910338688:0@lo:400:kworker.0 00000100:00100000:1.0:1789131250.139579:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131250.139608:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131250.139717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131250.139971:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339456 00000100:00100000:1.0:1789131250.139981:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339456 00000100:00100000:1.0:1789131250.140047:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789131250.140057:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910339456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131250.140103:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131250.140223:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910339456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 166us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131250.140232:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1789131250.141166:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7437da40 x1876039910339456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131250.141194:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910339456:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131250.273803:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131251.290345:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131252.313512:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131252.485395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131252.485506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131252.485533:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131252.485553:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131252.485576:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131252.485826:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529472 00000100:00100000:3.0:1789131252.485840:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529472 00000100:00100000:3.0:1789131252.485892:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529600 00000100:00100000:3.0:1789131252.485895:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529600 00000100:00100000:3.0:1789131252.486682:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1789131252.486703:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893529472:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131252.487165:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893529472:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 464us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131252.489928:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:1.0:1789131252.489957:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529600:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131252.490044:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529600:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131252.490052:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1789131252.491038:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1789131252.491090:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529728 00000100:00100000:3.0:1789131252.491097:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529728 00000100:00100000:3.0:1789131252.491154:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529856 00000100:00100000:3.0:1789131252.491158:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529856 00000100:00100000:3.0:1789131252.491178:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1789131252.491186:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529728:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131252.491234:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45c3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529728:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 49us (5728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131252.491241:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1789131252.491428:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1789131252.491436:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529856:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131252.491461:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893529856:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (5884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131252.491466:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00080000:3.0:1789131252.491483:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131252.491486:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131252.491489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131252.491537:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529344 00000100:00100000:3.0:1789131252.491541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529344 00000100:00100000:3.0:1789131252.491566:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:3.0:1789131252.491573:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893529344:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131252.491596:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893529344:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (6063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131252.491609:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:2.0:1789131253.209561:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910339584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131253.209741:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131253.209851:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339584 00000100:00100000:1.0:1789131253.209859:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339584 00000100:00080000:3.0:1789131253.209935:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131253.209940:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789131253.209954:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910339584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131253.209991:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131253.210518:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910339584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 566us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131253.210528:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789131253.210575:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00cb40 x1876039910339584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131253.210597:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910339584:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789131253.340430:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131254.362976:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131254.746619:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910339840:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746694:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.746746:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910340352:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746771:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.746802:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789131254.746808:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910339712:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746836:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.746856:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910340224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746878:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.746903:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910339968:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.746959:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131254.746965:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910340096:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.746987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131254.747018:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339840 00000100:00100000:2.0:1789131254.747026:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339840 00000100:00100000:2.0:1789131254.747063:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340224 00000100:00100000:2.0:1789131254.747066:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340224 00000100:00100000:2.0:1789131254.747091:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339968 00000100:00100000:2.0:1789131254.747094:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339968 00000100:00100000:2.0:1789131254.747110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789131254.747118:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910339840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747167:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910339840:12345-0@lo:400:kworker.0 Request processed in 49us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747174:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789131254.747190:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789131254.747196:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910340224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747238:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910340224:12345-0@lo:400:kworker.0 Request processed in 42us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789131254.747270:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131254.747277:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910339968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747308:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910339968:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747315:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131254.747362:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340352 00000100:00100000:2.0:1789131254.747366:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340352 00000100:00100000:2.0:1789131254.747393:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340096 00000100:00100000:2.0:1789131254.747395:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340096 00000100:00100000:2.0:1789131254.747412:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789131254.747418:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910340352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747448:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910340352:12345-0@lo:400:kworker.0 Request processed in 30us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747454:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789131254.747467:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131254.747472:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910340096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747495:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910340096:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747501:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131254.747520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910339712 00000100:00100000:2.0:1789131254.747524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910339712 00000100:00100000:2.0:1789131254.747547:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789131254.747553:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910339712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747591:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910339712:12345-0@lo:400:kworker.0 Request processed in 37us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131254.747597:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:2.0:1789131254.747632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131254.747637:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131254.747674:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67cf00 x1876039910340096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131254.747687:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910340096:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910339968:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747724:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910339712:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747733:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910340224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131254.747742:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910339840:0@lo:400:kworker.0 00010000:00080000:2.0:1789131254.747752:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67da40 x1876039910340352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131254.747760:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910340352:0@lo:400:kworker.0 00000100:00100000:0.0:1789131255.269630:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131255.269653:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910340480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131255.269722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131255.273503:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340480 00000100:00100000:1.0:1789131255.273517:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340480 00000100:00100000:1.0:1789131255.273586:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789131255.273596:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910340480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131255.274402:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131255.274526:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910340480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 930us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131255.274535:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789131255.275905:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7437f0c0 x1876039910340480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131255.275940:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910340480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131255.385980:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131256.410642:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131257.433725:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131257.602273:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131257.602843:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131257.602879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131257.602928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893529984 00000100:00100000:1.0:1789131257.602937:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893529984 00000100:00100000:1.0:1789131257.602983:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:1.0:1789131257.602992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893529984:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131257.603058:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893529984:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131257.603067:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:3.0:1789131257.610167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131257.610196:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131257.610219:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530368 00000100:00100000:3.0:1789131257.610228:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530368 00000100:00100000:3.0:1789131257.610278:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530496 00000100:00100000:3.0:1789131257.610282:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530496 00000100:00100000:3.0:1789131257.610306:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131257.610315:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2351:x1876039893530368:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1789131257.610361:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904536 00000100:00080000:3.0:1789131257.610371:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a799000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789131257.610407:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789131257.611376:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+2:2351:x1876039893530368:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 1058us (1214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131257.611386:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131257.611410:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131257.611419:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2351:x1876039893530496:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:3.0:1789131257.611434:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790453d 00000100:00080000:3.0:1789131257.611440:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a79e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789131257.611467:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789131257.611681:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+2:2351:x1876039893530496:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 264us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131257.611875:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1789131257.611911:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131257.611914:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789131257.611929:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131257.611935:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131257.614800:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530112 00000100:00100000:0.0:1789131257.614991:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530112 00000100:00100000:2.0:1789131257.615300:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530240 00000100:00100000:2.0:1789131257.615305:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530240 00000100:00080000:3.0:1789131257.615362:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131257.615389:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1789131257.615399:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893530240:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131257.615480:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893530240:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (12600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131257.615488:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1789131257.618109:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1789131257.618122:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893530112:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131257.618195:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893530112:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (15930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131257.618202:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00080000:2.0:1789131257.619177:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131258.332672:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910340608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131258.332740:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131258.333703:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340608 00000100:00100000:3.0:1789131258.333712:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340608 00000100:00100000:3.0:1789131258.333784:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789131258.333795:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910340608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131258.333832:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131258.333898:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910340608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131258.333906:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1789131258.334872:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131258.334977:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a00d2c0 x1876039910340608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131258.334998:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910340608:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1789131258.395167:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00000020:00000080:0.0:1789131258.395251:0:6729:0:(genops.c:885:class_export_put()) final put ffff9c0c7a798000/ea032118-1b0a-4f07-916a-9ad64f96010c 00000020:00000080:1.0:1789131258.395510:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a798000/ea032118-1b0a-4f07-916a-9ad64f96010c for lustre-OST0000 00000020:00000080:1.0:1789131258.395633:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7a799000 for lustre-OST0000 00010000:00010000:3.0:1789131258.457557:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131259.416532:0:11043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789131259.481643:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131259.865791:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910340992:0@lo:400:kworker.0 00000100:00100000:3.0:1789131259.865874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131259.865970:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131259.865976:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910341120:0@lo:400:kworker.0 00000100:00100000:3.0:1789131259.866003:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131259.866036:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910341120 00000100:00100000:3.0:1789131259.866043:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910341120 00000100:00100000:0.0:1789131259.866171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340992 00000100:00100000:0.0:1789131259.866176:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340992 00000100:00100000:0.0:1789131259.866209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789131259.866218:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910340992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131259.866272:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910340992:12345-0@lo:400:kworker.0 Request processed in 55us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131259.866279:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789131259.866372:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910340992:0@lo:400:kworker.0 00000100:00100000:3.0:1789131259.866527:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789131259.866539:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910341120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131259.866578:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910341120:12345-0@lo:400:kworker.0 Request processed in 42us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131259.866645:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910340736:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.866682:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131259.866710:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910341248:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.866732:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131259.866758:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789131259.866764:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910340864:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.866786:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131259.866803:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910341376:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.866822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131259.866853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340736 00000100:00100000:1.0:1789131259.866857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340736 00000100:00100000:1.0:1789131259.866896:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789131259.866904:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910340736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.866938:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910340736:12345-0@lo:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131259.866944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789131259.866977:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910340736:0@lo:400:kworker.0 00010000:00080000:1.0:1789131259.867008:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbe1c0 x1876039910341120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131259.867019:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910341120:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.867041:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910341248 00000100:00100000:1.0:1789131259.867045:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910341248 00000100:00100000:1.0:1789131259.867070:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910340864 00000100:00100000:1.0:1789131259.867073:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910340864 00000100:00100000:1.0:1789131259.867088:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789131259.869176:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131259.870227:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.870340:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910341248:12345-0@lo:400:kworker.0 Request processed in 132us (3605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131259.875676:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910341376 00000100:00100000:0.0:1789131259.875691:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910341376 00000100:00100000:0.0:1789131259.875771:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789131259.875781:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910341376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131259.875872:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910341376:12345-0@lo:400:kworker.0 Request processed in 93us (9048us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131259.875889:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789131259.876247:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789131259.877564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789131259.877586:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131259.877605:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910340864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131259.877682:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910340864:12345-0@lo:400:kworker.0 Request processed in 107us (10894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131259.877689:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789131259.877778:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910340864:0@lo:400:kworker.0 00010000:00080000:2.0:1789131259.877807:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5314fc00 x1876039910341376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131259.877818:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5314fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910341376:0@lo:400:kworker.0 00000100:00100000:2.0:1789131259.877831:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910341248:0@lo:400:kworker.0 00000100:00100000:1.0:1789131259.884269:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789131260.381604:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910341504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131260.381701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131260.381803:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910341504 00000100:00100000:1.0:1789131260.381823:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910341504 00000100:00100000:1.0:1789131260.381901:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789131260.381913:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5314fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910341504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131260.381951:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131260.382010:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5314fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910341504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131260.382018:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789131260.382073:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7437f0c0 x1876039910341504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131260.382091:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910341504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131260.505941:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131261.529575:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789131262.540836:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00000020:00000080:2.0:1789131262.540848:0:7662:0:(genops.c:885:class_export_put()) final put ffff9c0c7a79d000/ea032118-1b0a-4f07-916a-9ad64f96010c 00000020:00000080:1.0:1789131262.541133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a79d000/ea032118-1b0a-4f07-916a-9ad64f96010c for lustre-OST0001 00000020:00000080:1.0:1789131262.541274:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7a79e800 for lustre-OST0001 00010000:00010000:2.0:1789131262.555298:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131262.722311:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131262.722390:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131262.722435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131262.722474:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530880 00000100:00100000:1.0:1789131262.722486:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530880 00000100:00100000:1.0:1789131262.722567:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530752 00000100:00100000:1.0:1789131262.722571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530752 00000100:00100000:2.0:1789131262.722633:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893530624 00000100:00100000:2.0:1789131262.722638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893530624 00000100:00100000:1.0:1789131262.722709:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1789131262.722722:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893530880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131262.722815:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893530880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131262.722823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1789131262.723149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1789131262.723155:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1789131262.723165:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893530752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131262.723170:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893530624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131262.723292:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893530624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 127us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131262.723299:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1789131262.723395:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893530752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 234us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131262.723403:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00080000:0.0:1789131262.723426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1789131262.922579:0:11191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe86e43fa0 20000000:00000080:2.0:1789131262.922604:0:11191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c47f20400 uarg=0000000000000000 20000000:01000000:2.0:1789131262.922898:0:11191:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789131262.922906:0:11191:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789131262.922912:0:11191:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789131262.924092:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789131262.924586:0:11191:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789131262.931101:0:11191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789131262.931141:0:11191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931164:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044a3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931173:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044cd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931181:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931192:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931300:0:11191:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931309:0:11191:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931534:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931571:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 12 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.931588:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341632:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131262.931734:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931743:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 12 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.931752:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341760:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131262.931784:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931793:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.931802:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341888:0@lo:104: 00000100:00100000:2.0:1789131262.931847:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131262.931900:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.931909:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 18 pid: 5837 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131262.932559:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910341888 00000100:00100000:1.0:1789131262.932569:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910341888 00000100:00100000:1.0:1789131262.932623:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131262.932633:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11191:x1876039910341888:12345-0@lo:104: 00010000:00010000:1.0:1789131262.932649:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131262.932722:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131262.932728:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11191:x1876039910341888:12345-0@lo:104: Request processed in 97us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131262.932736:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789131262.932797:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131262.932806:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.932814:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b8400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131262.932819:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.932829:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131262.932838:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131262.932844:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789131262.932893:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.932900:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131262.932933:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.932940:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8400/0x9f0de371879044f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044fe expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.932954:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.932956:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.932958:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131262.932980:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910342144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131262.933024:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131262.933072:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342144 00000100:00100000:3.0:1789131262.933076:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342144 00010000:00010000:3.0:1789131262.933095:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 19 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131262.933116:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789131262.933122:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910342144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131262.933133:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131262.933138:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 19 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.933149:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 19 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.933167:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131262.933190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493c5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910342144:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131262.933196:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789131262.933274:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910342144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131262.933635:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910342016:0@lo:104: 00000100:00100000:2.0:1789131262.933680:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131262.933762:0:11191:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.933775:0:11191:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 18 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.933786:0:11191:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910342272:0@lo:104: 00000100:00100000:2.0:1789131262.933808:0:11191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131262.938134:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131262.938436:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531008 00000100:00100000:0.0:1789131262.938448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531008 00010000:00010000:0.0:1789131262.938499:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 13 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131262.938543:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1789131262.938554:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893531008:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131262.938572:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131262.938579:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 13 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.938593:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 13 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.938623:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131262.938704:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893531008:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 151us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131262.938713:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1789131262.939170:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131262.939632:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531136 00000100:00100000:3.0:1789131262.939640:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531136 00010000:00010000:3.0:1789131262.939724:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 13 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131262.939755:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1789131262.939779:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893531136:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131262.939791:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131262.939796:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 13 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.939809:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 13 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.939826:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131262.939876:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893531136:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 98us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131262.939883:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1789131262.941629:0:11191:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4da80 going to sleep for 11 seconds 00010000:00010000:2.0:1789131262.941779:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e14600/0x9f0de37187904528 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039566 expref: 12 pid: 5839 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.941799:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341632:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131262.941895:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e14800/0x9f0de37187904513 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03952e expref: 11 pid: 5838 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.941905:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341760:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131262.941917:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414a6200/0x9f0de371879044fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879044f7 expref: 18 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.941995:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910341888:0@lo:104: 00000100:00100000:1.0:1789131262.943490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342016 00000100:00100000:1.0:1789131262.943506:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342016 00000100:00100000:3.0:1789131262.943621:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342272 00000100:00100000:3.0:1789131262.943626:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342272 00000100:00100000:1.0:1789131262.943641:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789131262.943652:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:11191:x1876039910342016:12345-0@lo:104: 00010000:00010000:1.0:1789131262.943674:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131262.943802:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131262.943808:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:11191:x1876039910342016:12345-0@lo:104: Request processed in 158us (10129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131262.943816:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789131262.943836:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131262.943843:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11191:x1876039910342272:12345-0@lo:104: 00010000:00010000:1.0:1789131262.943851:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131262.943902:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789131262.943907:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11191:x1876039910342272:12345-0@lo:104: Request processed in 65us (10098us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131262.943912:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131262.944023:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910342016:0@lo:104: 00000100:00100000:2.0:1789131262.944033:0:11191:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11191:1876039910342272:0@lo:104: 00010000:00010000:2.0:1789131262.944075:0:11191:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.944127:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131262.944137:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.944145:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131262.944150:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.944174:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131262.944182:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131262.944188:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131262.944450:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.944458:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131262.944489:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789131262.944577:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910342400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131262.944627:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131262.944645:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.944652:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.944659:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131262.944662:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.944670:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131262.944677:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131262.944682:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789131262.944707:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.944714:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131262.944721:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.944729:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de371879044a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044aa expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131262.944741:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.944743:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.944744:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.944748:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131262.944750:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131262.944793:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910342528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131262.944824:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131262.944986:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342400 00000100:00100000:3.0:1789131262.944993:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342400 00010000:00010000:3.0:1789131262.945017:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 18 pid: 5837 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131262.945075:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342528 00000100:00100000:3.0:1789131262.945080:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342528 00010000:00010000:3.0:1789131262.945094:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 19 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131262.945125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131262.945136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910342400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131262.945149:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131262.945155:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 19 pid: 5837 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945168:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 19 pid: 5837 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945185:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879044d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879044cd expref: 19 pid: 5837 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945318:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131262.945488:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3308:x1876039910342400:12345-0@lo:103:ldlm_bl.0 Request processed in 355us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131262.945497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131262.945515:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131262.945522:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3309:x1876039910342528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131262.945530:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131262.945534:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 17 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945542:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 17 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945552:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031000/0x9f0de371879044aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879044a3 expref: 17 pid: 5838 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945563:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945579:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945597:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945604:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945611:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945618:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945623:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131262.945627:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945635:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945651:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945662:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131262.945690:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3309:x1876039910342528:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131262.945696:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789131262.945726:0:11191:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945741:0:11191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131262.945748:0:11191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904544 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.948415:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.948442:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb800/0x9f0de371879044cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879044d4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131262.948467:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131262.948469:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131262.948472:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131262.948824:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910342400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131262.948904:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910342528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131263.449631:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131263.449673:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910342656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131263.449779:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131263.449877:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342656 00000100:00100000:3.0:1789131263.449886:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342656 00000100:00100000:3.0:1789131263.449998:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789131263.450011:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910342656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131263.450064:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131263.450117:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910342656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131263.450125:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1789131263.450172:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55a72d00 x1876039910342656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131279 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131263.450191:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910342656:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131263.450234:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789131263.577875:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131264.601735:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789131264.619809:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131264.619822:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0b41ae9800 from 7 10000000:01000000:0.0:1789131264.619829:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131264.619916:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.619931:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.619945:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131264.620003:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910342784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.620100:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131264.620174:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42dcc300 going to sleep for 11 seconds 00000100:00100000:2.0:1789131264.621955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342784 00000100:00100000:2.0:1789131264.621975:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342784 00000100:00100000:2.0:1789131264.622063:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789131264.622075:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910342784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131264.622100:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131264.622126:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790454b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.622159:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790454b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.622172:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790454b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.622183:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131264.622275:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910342784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131264.622282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789131264.622454:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910342784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131264.622475:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.622486:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131264.622577:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.622614:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131264.622648:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910342912 00000100:00100000:0.0:1789131264.622652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910342912 00000100:00100000:0.0:1789131264.622680:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789131264.622687:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910342912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.623021:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910342912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 334us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.623029:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789131264.623127:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42dcc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131264.623142:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910342912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.623175:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.623219:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131264.623240:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343040 00000100:00100000:0.0:1789131264.623251:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343040 00000100:00100000:0.0:1789131264.623274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789131264.623281:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910343040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.623547:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910343040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.623555:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789131264.623585:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42dcc300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131264.623598:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343040:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131264.635077:0:11248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789131264.640580:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789131264.640632:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131264.640649:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.640665:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131264.640921:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789131264.640926:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172800 from 7 10000000:01000000:1.0:1789131264.640930:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131264.640998:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131264.641007:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131264.641020:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131264.641055:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789131264.641151:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131264.641210:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131264.642839:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343168 00000100:00100000:0.0:1789131264.642867:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343168 00000100:00100000:0.0:1789131264.642963:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789131264.642976:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910343168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131264.642999:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131264.643022:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904559 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.643059:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904559 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.643072:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904559 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.643094:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15000, rc 0) 00000100:00100000:0.0:1789131264.643203:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (2052us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.643211:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789131264.643861:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131264.643891:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.643903:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131264.643998:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.644046:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.644094:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c452563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131264.645886:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343296 00000100:00100000:2.0:1789131264.645904:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343296 00000100:00100000:2.0:1789131264.645973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789131264.646001:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131264.646442:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 442us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131264.646452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789131264.647056:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.647141:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.647206:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.647275:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c452563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131264.647624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343424 00000100:00100000:2.0:1789131264.647633:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343424 00000100:00100000:2.0:1789131264.647685:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789131264.647696:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131264.647940:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131264.647948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789131264.648097:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343424:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789131264.651166:0:11249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789131264.651904:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789131264.651934:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131264.651950:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.651963:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131264.651976:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131264.651980:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 7 10000000:01000000:2.0:1789131264.651983:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131264.652036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.652045:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.652059:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131264.652111:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131264.652208:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131264.652388:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4da80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131264.652534:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343552 00000100:00100000:3.0:1789131264.652544:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343552 00000100:00100000:3.0:1789131264.652604:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789131264.652617:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910343552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131264.652637:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131264.652655:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904567 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.652684:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904567 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.652697:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904567 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.652708:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f800, rc 0) 00000100:00100000:3.0:1789131264.652754:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910343552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.652762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789131264.652856:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131264.652876:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.652886:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131264.652964:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.652993:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.653010:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256180 going to sleep for 11 seconds 00000100:00100000:0.0:1789131264.653949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343680 00000100:00100000:0.0:1789131264.653961:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343680 00000100:00100000:0.0:1789131264.654021:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789131264.654031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910343680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.654431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910343680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 399us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.654440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789131264.655088:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131264.655166:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131264.655237:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131264.655288:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131264.655417:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343808 00000100:00100000:3.0:1789131264.655424:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343808 00000100:00100000:3.0:1789131264.655464:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1789131264.655474:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910343808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.655689:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910343808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.655696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789131264.656522:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910343808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131264.659306:0:11250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789131264.659805:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789131264.659854:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789131264.659871:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131264.659885:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131264.900385:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131264.900449:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531264 00000100:00100000:2.0:1789131264.900463:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531264 00000100:00100000:2.0:1789131264.900516:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:2.0:1789131264.900526:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:5592:x1876039893531264:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131264.900541:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131264.900558:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039590 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.900585:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.900596:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131264.900605:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb000, rc 0) 00000100:00100000:2.0:1789131264.900660:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531264:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 135us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131264.900674:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:2.0:1789131264.907912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131264.908014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531392 00000100:00100000:3.0:1789131264.908024:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531392 00000100:00100000:3.0:1789131264.908076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:3.0:1789131264.908084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531392:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.908373:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531392:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 288us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.908382:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:2.0:1789131264.932374:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131264.932455:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531520 00000100:00100000:0.0:1789131264.932467:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531520 00000100:00100000:0.0:1789131264.932516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:0.0:1789131264.932526:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531520:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131264.932726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531520:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.932733:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:3.0:1789131264.944838:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131264.944995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531648 00000100:00100000:0.0:1789131264.945004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531648 00000100:00100000:0.0:1789131264.945059:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:0.0:1789131264.945070:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893531648:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131264.945089:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131264.945108:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039597 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.945149:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.945160:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131264.945171:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15400, rc 0) 00000100:00100000:0.0:1789131264.945233:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893531648:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 165us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.945241:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:0.0:1789131264.948007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131264.948131:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531776 00000100:00100000:3.0:1789131264.948141:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531776 00000100:00100000:3.0:1789131264.948194:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:3.0:1789131264.948204:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893531776:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.948499:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893531776:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 296us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.948508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:1.0:1789131264.951966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131264.952046:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893531904 00000100:00100000:3.0:1789131264.952057:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893531904 00000100:00100000:3.0:1789131264.952115:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:3.0:1789131264.952125:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893531904:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131264.952348:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893531904:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 224us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.952356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:0.0:1789131264.986971:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910343936:0@lo:400:kworker.0 00000100:00100000:0.0:1789131264.987050:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131264.995549:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131264.995571:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910344320:0@lo:400:kworker.0 00000100:00100000:0.0:1789131264.995661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131264.995744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910343936 00000100:00100000:0.0:1789131264.995751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910343936 00000100:00100000:0.0:1789131264.995792:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344320 00000100:00100000:0.0:1789131264.995795:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344320 00000100:00100000:0.0:1789131264.995838:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789131264.995858:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910343936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131264.995916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910343936:12345-0@lo:400:kworker.0 Request processed in 60us (8866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.995925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789131264.996242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789131264.996265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910344320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131264.996302:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910344320:12345-0@lo:400:kworker.0 Request processed in 40us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131264.996308:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789131264.996377:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910344320:0@lo:400:kworker.0 00000100:00100000:0.0:1789131264.996391:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a721c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910343936:0@lo:400:kworker.0 00000100:00080000:3.0:1789131264.996609:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131264.996635:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910344064:0@lo:400:kworker.0 00000100:00100000:3.0:1789131264.996879:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.997127:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131264.997136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910344192:0@lo:400:kworker.0 00000100:00100000:3.0:1789131264.997166:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.997246:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910344448:0@lo:400:kworker.0 00000100:00100000:3.0:1789131264.997270:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131264.997309:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344192 00000100:00100000:3.0:1789131264.997314:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344192 00000100:00100000:3.0:1789131264.997379:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344448 00000100:00100000:3.0:1789131264.997393:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344448 00000100:00100000:3.0:1789131264.997424:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789131264.997432:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910344192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131264.997477:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910344192:12345-0@lo:400:kworker.0 Request processed in 45us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.997484:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789131264.997500:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131264.997506:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910344448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131264.997539:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910344448:12345-0@lo:400:kworker.0 Request processed in 33us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131264.997546:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789131264.997565:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789131264.997588:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea5a40 x1876039910344192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131264.997601:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910344192:0@lo:400:kworker.0 00010000:00080000:3.0:1789131264.997627:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea4b40 x1876039910344448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131264.997637:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910344448:0@lo:400:kworker.0 00000100:00100000:2.0:1789131265.001129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344064 00000100:00100000:2.0:1789131265.001142:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344064 00000100:00100000:2.0:1789131265.001271:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789131265.001285:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910344064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131265.001395:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910344064:12345-0@lo:400:kworker.0 Request processed in 114us (4515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131265.001403:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789131265.001451:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910344064:0@lo:400:kworker.0 00000100:00080000:3.0:1789131265.003179:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131265.505727:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131265.505751:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910344576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131265.505818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131265.505872:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344576 00000100:00100000:0.0:1789131265.505881:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344576 00000100:00100000:0.0:1789131265.505936:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131265.506044:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910344576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131265.506081:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131265.506141:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910344576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (321us total) trans 0 rc 0/0 00010000:00080000:1.0:1789131265.506197:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67cf00 x1876039910344576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131281 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131265.506217:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910344576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131265.507184:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1789131265.626584:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131266.659212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789131267.502563:0:11390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789131267.678809:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131267.845488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131267.845564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131267.845604:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131267.845720:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532288 00000100:00100000:2.0:1789131267.845729:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532288 00000100:00100000:2.0:1789131267.845795:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532160 00000100:00100000:2.0:1789131267.845799:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532160 00000100:00100000:2.0:1789131267.845840:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1789131267.845851:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893532288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131267.845928:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893532288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131267.845937:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1789131267.845953:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:2.0:1789131267.845976:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893532160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131267.846006:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893532160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131267.846011:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00080000:1.0:1789131267.846081:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131267.846852:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532032 00000100:00100000:0.0:1789131267.846859:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532032 00000100:00100000:0.0:1789131267.846904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:0.0:1789131267.846913:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893532032:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131267.847046:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893532032:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 134us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131267.847053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 243 00000100:00100000:2.0:1789131268.571729:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910344704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131268.571796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131268.571991:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344704 00000100:00100000:1.0:1789131268.571999:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344704 00000100:00100000:1.0:1789131268.572121:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789131268.572130:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910344704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131268.572175:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131268.572240:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910344704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131268.572248:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1789131268.573810:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67d680 x1876039910344704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131268.573849:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910344704:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131268.576942:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131268.701461:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131269.724412:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131270.105498:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910345216:0@lo:400:kworker.0 00000100:00100000:1.0:1789131270.105561:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910344960:0@lo:400:kworker.0 00000100:00100000:3.0:1789131270.105569:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131270.105614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131270.105632:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131270.105641:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910345088:0@lo:400:kworker.0 00000100:00100000:1.0:1789131270.105651:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910345472:0@lo:400:kworker.0 00000100:00100000:3.0:1789131270.105671:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131270.105684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131270.105719:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345216 00000100:00100000:1.0:1789131270.105724:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789131270.105726:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345216 00000100:00100000:1.0:1789131270.105732:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910344832:0@lo:400:kworker.0 00000100:00100000:1.0:1789131270.105762:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131270.105784:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910345344:0@lo:400:kworker.0 00000100:00100000:1.0:1789131270.105817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131270.105850:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345472 00000100:00100000:1.0:1789131270.105854:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345472 00000100:00100000:0.0:1789131270.105894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344960 00000100:00100000:0.0:1789131270.105900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344960 00000100:00100000:0.0:1789131270.105933:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345088 00000100:00100000:0.0:1789131270.105936:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345088 00000100:00100000:0.0:1789131270.105961:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345344 00000100:00100000:0.0:1789131270.105969:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345344 00000100:00100000:0.0:1789131270.105991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789131270.106001:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106055:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910344960:12345-0@lo:400:kworker.0 Request processed in 55us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131270.106063:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789131270.106080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789131270.106094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106132:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910345088:12345-0@lo:400:kworker.0 Request processed in 46us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131270.106138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789131270.106148:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789131270.106154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910345344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910345344:12345-0@lo:400:kworker.0 Request processed in 26us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131270.106186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789131270.106225:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910345088:0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910345344:0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106259:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910344960:0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910344832 00000100:00100000:0.0:1789131270.106295:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910344832 00000100:00100000:0.0:1789131270.106353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789131270.106360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910344832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.106393:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910344832:12345-0@lo:400:kworker.0 Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131270.106406:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789131270.106456:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910344832:0@lo:400:kworker.0 00000100:00100000:3.0:1789131270.106657:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131270.106665:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131270.106706:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131270.106707:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910345216:12345-0@lo:400:kworker.0 Request processed in 41us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131270.106717:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789131270.106721:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910345472:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789131270.106748:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131270.106754:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131270.106757:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131270.106768:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910345472:12345-0@lo:400:kworker.0 Request processed in 53us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131270.106776:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1789131270.106968:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c52c0 x1876039910345216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131270.106981:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910345216:0@lo:400:kworker.0 00010000:00080000:0.0:1789131270.107007:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c43c0 x1876039910345472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131286 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131270.107015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910345472:0@lo:400:kworker.0 00000100:00100000:0.0:1789131270.625187:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910345600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131270.625256:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131270.625492:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345600 00000100:00100000:0.0:1789131270.625500:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345600 00000100:00100000:0.0:1789131270.625559:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789131270.625569:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910345600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131270.625610:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131270.625846:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910345600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 277us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131270.625854:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789131270.626730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74fbc000 x1876039910345600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131286 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131270.626750:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910345600:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131270.752766:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131271.783414:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131272.793535:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131272.977601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131272.977643:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131272.977684:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131272.977714:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532544 00000100:00100000:1.0:1789131272.977722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532544 00000100:00100000:1.0:1789131272.977777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532672 00000100:00100000:1.0:1789131272.977780:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532672 00000100:00100000:1.0:1789131272.977817:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1789131272.977826:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893532544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131272.977899:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893532544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 74us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131272.977906:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1789131272.977935:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1789131272.977944:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893532672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131272.977969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893532672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131272.977975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00080000:1.0:1789131272.977991:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131272.978251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532416 00000100:00100000:3.0:1789131272.978257:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532416 00000100:00100000:3.0:1789131272.978291:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:3.0:1789131272.978299:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893532416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131272.978353:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893532416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 55us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131272.978360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000020:00000080:2.0:1789131272.983361:0:11634:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd77bb8f50 20000000:00000080:2.0:1789131272.983379:0:11634:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c74de7400 uarg=0000000000000000 20000000:01000000:2.0:1789131272.983417:0:11634:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789131272.983423:0:11634:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:2.0:1789131272.983428:0:11634:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:2.0:1789131272.985917:0:11635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1789131272.986144:0:11634:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:3.0:1789131272.991236:0:11634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1789131272.991290:0:11634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:3.0:1789131272.991470:0:11634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:3.0:1789131272.991489:0:11634:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789131272.991512:0:11634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991530:0:11634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790454b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991537:0:11634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904559 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991553:0:11634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904567 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991562:0:11634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991576:0:11634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991582:0:11634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991618:0:11634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991635:0:11634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.991650:0:11634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345728:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131272.991769:0:11634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991777:0:11634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 12 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.991799:0:11634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345856:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131272.991834:0:11634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.991853:0:11634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 18 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.991861:0:11634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345984:0@lo:104: 00000100:00100000:3.0:1789131272.991912:0:11634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131272.991994:0:11634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.992002:0:11634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 18 pid: 5837 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.992010:0:11634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910346112:0@lo:104: 00000100:00100000:3.0:1789131272.992032:0:11634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131272.992586:0:11634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131272.992596:0:11634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 18 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.992605:0:11634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910346240:0@lo:104: 00000100:00100000:3.0:1789131272.992627:0:11634:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131272.992746:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789131272.992765:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131272.992777:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910345984 00000100:00100000:2.0:1789131272.992783:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910345984 00000100:00100000:2.0:1789131272.992827:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346112 00000100:00100000:2.0:1789131272.992830:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346112 00000100:00100000:2.0:1789131272.992840:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346240 00000100:00100000:2.0:1789131272.992842:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346240 00000100:00100000:2.0:1789131272.992986:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131272.992996:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:11634:x1876039910345984:12345-0@lo:104: 00010000:00010000:2.0:1789131272.993009:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993129:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789131272.993136:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:11634:x1876039910345984:12345-0@lo:104: Request processed in 142us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.993143:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131272.993162:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131272.993168:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a642450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:11634:x1876039910346112:12345-0@lo:104: 00010000:00010000:2.0:1789131272.993176:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993217:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789131272.993223:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a642450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:11634:x1876039910346112:12345-0@lo:104: Request processed in 56us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.993229:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789131272.993246:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131272.993253:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993260:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceba00 already unused, calling callback (ffffffffc1b0bc20) 00000100:00100000:2.0:1789131272.993261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789131272.993268:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11634:x1876039910346240:12345-0@lo:104: 10000000:00010000:0.0:1789131272.993271:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993275:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993279:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131272.993286:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131272.993292:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789131272.993315:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789131272.993340:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:11634:x1876039910346240:12345-0@lo:104: Request processed in 54us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.993347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1789131272.993361:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789131272.993370:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993377:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131272.993380:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993387:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131272.993393:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131272.993398:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131272.993406:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993411:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993412:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131272.993416:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131272.993423:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993429:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceba00/0x9f0de37187904567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790456e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993431:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993437:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7800/0x9f0de37187904559 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904560 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993443:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131272.993445:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131272.993446:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993447:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131272.993449:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131272.993452:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14200 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131272.993455:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993461:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131272.993465:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910346496:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789131272.993477:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131272.993482:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789131272.993491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789131272.993496:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993501:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789131272.993514:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910346368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131272.993516:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993522:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de3718790454b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187904552 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131272.993535:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131272.993537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131272.993538:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131272.993541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131272.993547:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910346624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131272.993569:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346496 00000100:00100000:2.0:1789131272.993573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346496 00000100:00100000:0.0:1789131272.993575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131272.993591:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 19 pid: 5837 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131272.993609:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346368 00000100:00100000:2.0:1789131272.993612:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346368 00010000:00010000:2.0:1789131272.993622:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 20 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131272.993632:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346624 00000100:00100000:2.0:1789131272.993635:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346624 00010000:00010000:2.0:1789131272.993643:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 21 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131272.993654:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131272.993659:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+21:3309:x1876039910346496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131272.993669:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131272.993674:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 21 pid: 5837 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993694:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 21 pid: 5837 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993711:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131272.993738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+21:3309:x1876039910346496:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.993744:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789131272.993757:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131272.993770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910346368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131272.993778:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131272.993782:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 20 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993801:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 20 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.993810:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131272.993832:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910346368:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.993838:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789131272.993850:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789131272.993856:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910346624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131272.994034:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131272.994041:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 19 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.994050:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 19 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131272.994059:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131272.994083:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910346624:12345-0@lo:103:ldlm_bl.0 Request processed in 227us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131272.994090:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131272.994117:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910346624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131272.994139:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910346496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131272.994146:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910346368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131272.994411:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131272.994813:0:11634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c7473f800/0x9f0de3718790456e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904567 expref: 18 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.994826:0:11634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345984:0@lo:104: 00010000:00010000:3.0:1789131272.995098:0:11634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15000/0x9f0de37187904560 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904559 expref: 17 pid: 5837 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.995137:0:11634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910346112:0@lo:104: 00010000:00010000:3.0:1789131272.995152:0:11634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41cea800/0x9f0de37187904552 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790454b expref: 16 pid: 5838 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131272.995160:0:11634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910346240:0@lo:104: 00000100:00100000:3.0:1789131272.995644:0:11634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345728:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131272.995654:0:11634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11634:1876039910345856:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131272.995813:0:11634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131272.998445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131272.998986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131273.000619:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532928 00000100:00100000:2.0:1789131273.000645:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532928 00010000:00010000:2.0:1789131273.000687:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 13 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131273.000725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893532800 00000100:00100000:2.0:1789131273.000729:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893532800 00010000:00010000:2.0:1789131273.000741:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 14 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131273.000776:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1789131273.000795:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+14:2353:x1876039893532928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131273.000810:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131273.000815:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 14 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000825:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 14 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000842:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceb000/0x9f0de37187904575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039590 expref: 14 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000856:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131273.000899:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893532928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 116us (2464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131273.000906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1789131273.000919:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1789131273.000925:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:2353:x1876039893532800:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131273.000931:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131273.000935:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000949:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000959:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15400/0x9f0de3718790457c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039597 expref: 12 pid: 5838 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000970:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000978:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.000992:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001000:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001007:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001013:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001019:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131273.001024:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001033:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001065:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131273.001076:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131273.001097:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2353:x1876039893532800:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 171us (2112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131273.001103:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00010000:00010000:3.0:1789131273.002415:0:11634:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131273.002429:0:11634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131273.002435:0:11634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c7473f600/0x9f0de37187904583 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131273.694929:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910346752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131273.695015:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131273.695094:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346752 00000100:00100000:1.0:1789131273.695100:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346752 00000100:00100000:1.0:1789131273.695148:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789131273.695165:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910346752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131273.695197:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131273.695243:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910346752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131273.695250:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1789131273.695273:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131273.695314:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c5684a1c0 x1876039910346752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131273.695349:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910346752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789131273.821182:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131274.179705:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.180362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533056 00000100:00100000:0.0:1789131274.180373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533056 00000100:00100000:0.0:1789131274.180492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:0.0:1789131274.180502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:5592:x1876039893533056:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131274.180518:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131274.180536:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03959e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.182155:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.182180:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.182191:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15200, rc 0) 00000100:00100000:0.0:1789131274.182301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533056:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 1799us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.182310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:1.0:1789131274.190297:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.190424:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533184 00000100:00100000:0.0:1789131274.190434:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533184 00000100:00100000:0.0:1789131274.190488:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:0.0:1789131274.190499:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533184:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.190809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533184:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 312us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.190818:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:1.0:1789131274.195403:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.195478:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533312 00000100:00100000:0.0:1789131274.195487:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533312 00000100:00100000:0.0:1789131274.195540:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1789131274.195550:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533312:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.195787:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533312:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 230us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.195796:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1789131274.205874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131274.206288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533440 00000100:00100000:3.0:1789131274.206297:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533440 00000100:00100000:3.0:1789131274.206368:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:3.0:1789131274.206379:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:9511:x1876039893533440:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131274.206624:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:9511:x1876039893533440:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 247us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131274.206633:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:2.0:1789131274.213737:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131274.214433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533568 00000100:00100000:1.0:1789131274.214443:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533568 00000100:00100000:1.0:1789131274.214509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:1.0:1789131274.214520:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:9511:x1876039893533568:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131274.214766:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:9511:x1876039893533568:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 248us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131274.214786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:3.0:1789131274.221277:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.221485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533696 00000100:00100000:0.0:1789131274.221495:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533696 00000100:00100000:0.0:1789131274.221549:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:0.0:1789131274.221559:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893533696:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131274.221576:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131274.221591:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.221616:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.221627:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.221636:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14200, rc 0) 00000100:00100000:0.0:1789131274.221693:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893533696:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 136us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.221701:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:0.0:1789131274.224191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131274.224285:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533824 00000100:00100000:1.0:1789131274.224294:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533824 00000100:00100000:1.0:1789131274.224510:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:1.0:1789131274.224522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893533824:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131274.224821:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893533824:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 300us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131274.224841:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:2.0:1789131274.227130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.227581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893533952 00000100:00100000:0.0:1789131274.227592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893533952 00000100:00100000:0.0:1789131274.227637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:0.0:1789131274.227652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893533952:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.227911:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893533952:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 259us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.227919:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:3.0:1789131274.231069:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131274.231141:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534080 00000100:00100000:0.0:1789131274.231163:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534080 00000100:00100000:0.0:1789131274.231453:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:0.0:1789131274.231465:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:9514:x1876039893534080:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789131274.231720:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:9514:x1876039893534080:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 257us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.231728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 254 00000100:00100000:2.0:1789131274.239243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131274.239426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534208 00000100:00100000:3.0:1789131274.239435:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534208 00000100:00100000:3.0:1789131274.239486:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 255 00000100:00100000:3.0:1789131274.239495:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:9514:x1876039893534208:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131274.239766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:9514:x1876039893534208:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 269us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131274.239774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 255 00010000:00010000:0.0:1789131274.841498:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789131274.970416:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789131274.970425:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0b41ae9800 from 7 10000000:01000000:3.0:1789131274.970430:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789131274.970476:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131274.970496:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131274.970508:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131274.970533:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910346880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131274.970598:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131274.970651:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.970761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910346880 00000100:00100000:2.0:1789131274.970768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910346880 00000100:00100000:2.0:1789131274.970833:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789131274.970842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910346880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131274.970855:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131274.970867:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904598 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.970890:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904598 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.970900:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904598 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.970909:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea400, rc 0) 00000100:00100000:2.0:1789131274.970946:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910346880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.970964:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789131274.971692:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910346880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131274.971710:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131274.971733:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131274.971808:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131274.971844:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131274.971883:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256180 going to sleep for 11 seconds 00000100:00100000:3.0:1789131274.971901:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347008 00000100:00100000:3.0:1789131274.971905:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347008 00000100:00100000:3.0:1789131274.971937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789131274.971944:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910347008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.974688:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.974746:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.974810:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.974838:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0000 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.974852:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347136 00000100:00100000:2.0:1789131274.974858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347136 00000100:00100000:2.0:1789131274.974892:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789131274.974898:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910347136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.975048:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910347136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.975056:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789131274.975099:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.975278:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11698:1876039910347264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.975311:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.975353:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347264 00000100:00100000:2.0:1789131274.975357:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347264 00000100:00100000:2.0:1789131274.975377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789131274.975384:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11698:x1876039910347264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.975520:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11698:x1876039910347264:12345-0@lo:502:llog_process_th.0 Request processed in 135us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.975527:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789131274.975554:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.975565:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11698:1876039910347264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131274.975588:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131274.975597:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131274.975599:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131274.975606:0:11698:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0b41ae9800 00000020:00000080:2.0:1789131274.975608:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789131274.975672:0:11698:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11698:1876039910347392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.975805:0:11698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.975823:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347392 00000100:00100000:2.0:1789131274.975827:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347392 00000100:00100000:2.0:1789131274.975848:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789131274.975855:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11698:x1876039910347392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.975964:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11698:x1876039910347392:12345-0@lo:502:llog_process_th.0 Request processed in 109us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.975972:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789131274.976008:0:11698:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.976023:0:11698:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11698:1876039910347392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131274.976042:0:11698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131274.976046:0:11698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131274.976048:0:11698:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789131274.976052:0:11698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789131274.976100:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789131274.976117:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131274.976126:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976137:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131274.976161:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131274.976164:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172800 from 7 10000000:01000000:2.0:1789131274.976166:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131274.976188:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976196:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976205:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131274.976218:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.976252:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.976267:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.976278:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347520 00000100:00100000:2.0:1789131274.976282:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347520 00000100:00100000:2.0:1789131274.976305:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789131274.976312:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910347520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131274.976341:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131274.976353:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879045a6 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976374:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879045a6 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976384:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879045a6 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976403:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131274.976433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910347520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.976440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789131274.976470:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131274.976481:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.976490:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131274.976527:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.976550:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.976563:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.976573:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347648 00000100:00100000:2.0:1789131274.976576:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347648 00000100:00100000:2.0:1789131274.976596:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789131274.976602:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910347648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.976825:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910347648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.976831:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789131274.976859:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.976881:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.976915:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.976938:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0900 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.976951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347776 00000100:00100000:2.0:1789131274.976955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347776 00000100:00100000:2.0:1789131274.976975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789131274.976981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910347776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.977105:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910347776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.977111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789131274.977152:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910347776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131274.977414:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11699:1876039910347904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.977449:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.977467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910347904 00000100:00100000:2.0:1789131274.977471:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910347904 00000100:00100000:2.0:1789131274.977491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789131274.977497:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11699:x1876039910347904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.977642:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11699:x1876039910347904:12345-0@lo:502:llog_process_th.0 Request processed in 144us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.977649:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789131274.977681:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.977693:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11699:1876039910347904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131274.977713:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131274.977720:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131274.977723:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131274.977730:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43172800 00000020:00000080:2.0:1789131274.977733:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789131274.978572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910347008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2196us (2295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131274.978587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789131274.982015:0:11699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11699:1876039910348032:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131274.982099:0:11699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131274.982205:0:11699:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131274.982246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348032 00000100:00100000:0.0:1789131274.982254:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348032 00000100:00100000:0.0:1789131274.982352:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789131274.982362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11699:x1876039910348032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131274.982715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:11699:x1876039910348032:12345-0@lo:502:llog_process_th.0 Request processed in 353us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.982723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789131274.982883:0:11699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11699:1876039910348032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131274.982910:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131274.982917:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131274.982919:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789131274.982923:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789131274.983087:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789131274.983107:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131274.983117:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.983128:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131274.983138:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131274.983140:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 7 10000000:01000000:0.0:1789131274.983143:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131274.983169:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.983176:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.983191:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131274.983206:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.983237:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131274.983302:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789131274.983372:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348160 00000100:00100000:2.0:1789131274.983377:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348160 00000100:00100000:2.0:1789131274.983438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789131274.983446:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910348160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131274.983456:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131274.983536:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879045b4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.983559:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879045b4 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.983569:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879045b4 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131274.983577:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceba00, rc 0) 00000100:00100000:2.0:1789131274.983608:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910348160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131274.983614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789131274.983672:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131274.983684:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.983692:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131274.983732:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.983758:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131274.983794:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131274.983804:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348288 00000100:00100000:0.0:1789131274.983808:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348288 00000100:00100000:0.0:1789131274.983828:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789131274.983834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910348288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.984039:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910348288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.984047:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789131274.984078:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.984103:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.984142:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131274.984155:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131274.984167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348416 00000100:00100000:0.0:1789131274.984170:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348416 00000100:00100000:0.0:1789131274.984192:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789131274.984198:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910348416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.984336:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910348416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.984344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789131274.984380:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910348416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131274.984725:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11701:1876039910348544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131274.984758:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131274.984851:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348544 00000100:00100000:0.0:1789131274.984855:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348544 00000100:00100000:0.0:1789131274.984878:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789131274.984884:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11701:x1876039910348544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131274.985008:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11701:x1876039910348544:12345-0@lo:502:llog_process_th.0 Request processed in 123us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.985015:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789131274.985044:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131274.985057:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11701:1876039910348544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131274.985077:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131274.985085:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131274.985087:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789131274.985093:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43124000 00000020:00000080:0.0:1789131274.985100:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789131274.985396:0:11701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11701:1876039910348672:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131274.985432:0:11701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131274.985450:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348672 00000100:00100000:0.0:1789131274.985454:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348672 00000100:00100000:0.0:1789131274.985557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789131274.985564:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11701:x1876039910348672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131274.985677:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:11701:x1876039910348672:12345-0@lo:502:llog_process_th.0 Request processed in 113us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131274.985684:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789131274.985719:0:11701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131274.985730:0:11701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea43c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:11701:1876039910348672:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131274.985746:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789131274.985750:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131274.985752:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789131274.985755:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789131274.985990:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789131274.986007:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131274.986015:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131274.986026:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131275.225839:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910348800:0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.225922:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131275.226493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348800 00000100:00100000:0.0:1789131275.226500:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348800 00000100:00100000:0.0:1789131275.226543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789131275.226553:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910348800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.226681:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131275.226690:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910348928:0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.226727:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131275.226760:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910348928 00000100:00100000:3.0:1789131275.226764:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910348928 00000100:00100000:3.0:1789131275.226821:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789131275.226830:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131275.227576:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910348800:12345-0@lo:400:kworker.0 Request processed in 1020us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131275.227657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789131275.229198:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910348928:12345-0@lo:400:kworker.0 Request processed in 2363us (2463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131275.229211:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789131275.229301:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910348928:0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.229312:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910348800:0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.229760:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910349440:0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.230089:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910349312:0@lo:400:kworker.0 00000100:00100000:1.0:1789131275.230112:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910349056:0@lo:400:kworker.0 00000100:00100000:3.0:1789131275.230123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131275.230151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131275.230173:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131275.230179:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910349184:0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.230184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131275.230231:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349440 00000100:00100000:2.0:1789131275.230237:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349440 00000100:00100000:2.0:1789131275.230284:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789131275.230293:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910349440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.231548:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910349440:12345-0@lo:400:kworker.0 Request processed in 1250us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131275.231559:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789131275.231652:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789131275.231686:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67f480 x1876039910349440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131275.231699:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910349440:0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.231724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131275.231762:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349184 00000100:00100000:2.0:1789131275.231767:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349184 00000100:00100000:2.0:1789131275.232106:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789131275.232224:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910349184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.232277:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910349184:12345-0@lo:400:kworker.0 Request processed in 164us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131275.232284:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1789131275.232301:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789131275.232343:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a67da40 x1876039910349184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131275.232354:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910349184:0@lo:400:kworker.0 00000100:00100000:1.0:1789131275.232466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349312 00000100:00100000:1.0:1789131275.232471:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349312 00000100:00100000:1.0:1789131275.232503:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349056 00000100:00100000:1.0:1789131275.232506:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349056 00000100:00100000:1.0:1789131275.232535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789131275.232543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910349312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131275.232680:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910349312:12345-0@lo:400:kworker.0 Request processed in 137us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131275.232688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789131275.232704:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789131275.232711:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131275.232741:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910349056:12345-0@lo:400:kworker.0 Request processed in 32us (2589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131275.232747:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1789131275.232818:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131275.232849:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910349056:0@lo:400:kworker.0 00000100:00100000:2.0:1789131275.233449:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910349312:0@lo:400:kworker.0 00000100:00100000:0.0:1789131275.739038:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131275.739060:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131275.739125:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131275.739184:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349568 00000100:00100000:0.0:1789131275.739191:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349568 00000100:00100000:0.0:1789131275.739238:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789131275.739247:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910349568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131275.739282:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131275.739344:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910349568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131275.739352:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789131275.739392:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea4b40 x1876039910349568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131291 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131275.739408:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910349568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789131275.865994:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131276.890074:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131277.916339:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131278.094269:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131278.094341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131278.094386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131278.094508:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534336 00000100:00100000:0.0:1789131278.094518:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534336 00000100:00100000:0.0:1789131278.094583:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00100000:0.0:1789131278.094592:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893534336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131278.094658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893534336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 66us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131278.094665:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00100000:1.0:1789131278.095102:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534464 00000100:00100000:1.0:1789131278.095108:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534464 00000100:00100000:1.0:1789131278.095156:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534592 00000100:00100000:1.0:1789131278.095159:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534592 00000100:00100000:1.0:1789131278.095181:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1789131278.095189:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893534464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131278.095224:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893534464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131278.095238:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1789131278.095252:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1789131278.095259:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893534592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131278.095286:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893534592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131278.095292:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00080000:0.0:1789131278.095434:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131278.809707:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131278.809728:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910349696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131278.809807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131278.809899:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349696 00000100:00100000:1.0:1789131278.809907:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349696 00000100:00100000:1.0:1789131278.810014:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789131278.810025:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910349696:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131278.810131:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1789131278.810296:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131278.810374:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910349696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 351us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131278.810382:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789131278.810806:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c7c00 x1876039910349696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131278.810826:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910349696:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789131278.939926:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131279.052464:0:11836:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 08:54:38 (1789131278) === 00010000:00010000:2.0:1789131279.961569:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131280.346817:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910349824:0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.346918:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131280.347029:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910349952:0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.347061:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131280.347136:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910350336:0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.347160:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131280.347278:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.347306:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131280.347379:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350464 00000100:00100000:2.0:1789131280.347388:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350464 00000100:00100000:2.0:1789131280.347453:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789131280.347462:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910350464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.347516:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910350464:12345-0@lo:400:kworker.0 Request processed in 55us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131280.347524:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789131280.347672:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349824 00000100:00100000:0.0:1789131280.347677:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349824 00000100:00100000:0.0:1789131280.347708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789131280.347716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910349824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.347771:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910349824:12345-0@lo:400:kworker.0 Request processed in 56us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.347778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789131280.347813:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910349952 00000100:00100000:0.0:1789131280.347817:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910349952 00000100:00100000:0.0:1789131280.347842:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350336 00000100:00100000:0.0:1789131280.347845:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350336 00000100:00100000:0.0:1789131280.347867:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789131280.347873:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910349952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.347903:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910349952:12345-0@lo:400:kworker.0 Request processed in 31us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.347909:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789131280.347921:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789131280.347927:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910350336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.347953:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910350336:12345-0@lo:400:kworker.0 Request processed in 26us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.347959:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789131280.347979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910350208:0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348009:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131280.348034:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131280.348040:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910350080:0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131280.348138:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910350336:0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348148:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910349824:0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348191:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350208 00000100:00100000:0.0:1789131280.348195:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350208 00000100:00100000:0.0:1789131280.348224:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789131280.348231:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910350208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348264:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910350208:12345-0@lo:400:kworker.0 Request processed in 34us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.348271:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789131280.348299:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403da40 x1876039910350208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131280.348310:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910350208:0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348370:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350080 00000100:00100000:0.0:1789131280.348374:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350080 00000100:00100000:0.0:1789131280.348397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789131280.348403:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910350080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131280.348434:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910350080:12345-0@lo:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.348439:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789131280.348466:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910350080:0@lo:400:kworker.0 00010000:00080000:2.0:1789131280.348665:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403d2c0 x1876039910350464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131280.348677:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910350464:0@lo:400:kworker.0 00000100:00100000:2.0:1789131280.348694:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74fbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910349952:0@lo:400:kworker.0 00000100:00080000:2.0:1789131280.366395:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131280.366409:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789131280.366413:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131280.857525:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131280.857557:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910350592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131280.857649:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131280.857791:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350592 00000100:00100000:0.0:1789131280.857801:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350592 00000100:00100000:0.0:1789131280.857867:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789131280.857878:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910350592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131280.857953:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131280.858016:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910350592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131280.858025:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1789131280.858228:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c74ea4b40 x1876039910350592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131280.858250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910350592:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131280.986452:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131281.024855:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.024913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131281.024988:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534720 00000100:00100000:2.0:1789131281.025000:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534720 00000100:00100000:2.0:1789131281.025090:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1789131281.025105:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893534720:12345-192.168.203.52@tcp:41:mkdir.0 00000004:00000024:2.0:1789131281.025164:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789131281.025272:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893534720:12345-192.168.203.52@tcp:41:mkdir.0 Request processed in 171us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131281.025280:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:1.0:1789131281.025489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131281.025602:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893534848 00000100:00100000:3.0:1789131281.025608:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893534848 00000100:00100000:3.0:1789131281.025657:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1789131281.025666:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:9881:x1876039893534848:12345-192.168.203.52@tcp:700:mkdir.0 00000100:00100000:3.0:1789131281.025727:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:9881:x1876039893534848:12345-192.168.203.52@tcp:700:mkdir.0 Request processed in 62us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131281.025745:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1789131281.032539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131281.032627:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893535104 00000100:00100000:3.0:1789131281.032641:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893535104 00000100:00100000:3.0:1789131281.032718:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131281.032739:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:9881:x1876039893535104:12345-192.168.203.52@tcp:36:mkdir.0 00010000:00010000:3.0:1789131281.032795:0:9425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131281.032899:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414b8a00/0x9f0de37187904464 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039519 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.032918:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131281.032928:0:9425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131281.033285:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.033299:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.033308:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.033380:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.033389:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.033396:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131281.040719:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1789131281.040750:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.040761:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.040768:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.040787:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ee00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131281.040792:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.040800:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.040816:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c431fa900) 00010000:00010000:3.0:1789131281.040819:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131281.040824:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.041262:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879045c2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131281.041290:0:9425:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000012c080c4 reply state 0000000002675315 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131281.041299:0:9425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131281.041821:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9881:x1876039893535104:12345-192.168.203.52@tcp:36:mkdir.0 Request processed in 9089us (9293us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789131281.042618:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:2.0:1789131281.047084:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047101:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047109:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047116:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ea00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.047121:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047130:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047153:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0c431fae00) 00010000:00010000:2.0:1789131281.047181:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131281.047188:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.047195:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de371879045c9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131281.067223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131281.067400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893535232 00000100:00100000:2.0:1789131281.067414:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893535232 00000100:00100000:2.0:1789131281.067497:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1789131281.067508:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:9882:x1876039893535232:12345-192.168.203.52@tcp:101:chmod.0 00010000:00010000:2.0:1789131281.067539:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131281.067563:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879045d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395ac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.067625:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.067639:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.067650:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131281.067708:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1789131281.067712:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131281.067767:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.067792:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879045d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ac expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.067825:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ac expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.068078:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:2.0:1789131281.068081:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131281.068084:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebc00, rc 0) 00000100:00100000:2.0:1789131281.068155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9882:x1876039893535232:12345-192.168.203.52@tcp:101:chmod.0 Request processed in 648us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131281.068175:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131281.086710:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.086779:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893535488 00000100:00100000:1.0:1789131281.086796:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893535488 00000100:00100000:1.0:1789131281.086877:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1789131281.086889:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9882:x1876039893535488:12345-192.168.203.52@tcp:36:chmod.0 00010000:00010000:1.0:1789131281.086960:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131281.087005:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879045d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ac expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.087026:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131281.087043:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131281.087076:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.087090:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.087101:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131281.089026:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003135a159 reply state 00000000fde39a05 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131281.089048:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789131281.089079:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1789131281.089216:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:9882:x1876039893535488:12345-192.168.203.52@tcp:36:chmod.0 Request processed in 2324us (2511us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789131281.089226:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00010000:00010000:3.0:1789131281.091871:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091892:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091912:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091919:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131281.091924:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091934:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091956:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35200) 00010000:00010000:3.0:1789131281.091960:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789131281.091965:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.091972:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045de lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131281.135591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.135642:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893535616 00000100:00100000:1.0:1789131281.135654:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893535616 00000100:00100000:1.0:1789131281.135724:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1789131281.135746:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9883:x1876039893535616:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:1.0:1789131281.135780:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.135810:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395b3 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.136061:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.136081:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.136096:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.136176:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1789131281.137644:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131281.137779:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.138391:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879045e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395b3 expref: 9 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.138421:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395b3 expref: 8 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.138432:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35e00) 00010000:00010000:1.0:1789131281.138436:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131281.138440:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7c00, rc 0) 00000100:00100000:1.0:1789131281.138533:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:9883:x1876039893535616:12345-192.168.203.52@tcp:101:chown.0 Request processed in 2788us (2954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.138544:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1789131281.143071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131281.143168:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893535744 00000100:00100000:0.0:1789131281.143240:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893535744 00000100:00100000:0.0:1789131281.143314:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1789131281.143693:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:9883:x1876039893535744:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:1.0:1789131281.144156:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.144196:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879045f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395ba expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144298:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144315:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144360:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144378:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144386:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.144394:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146041:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146062:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146076:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.146135:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789131281.146139:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131281.146166:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146195:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146203:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146211:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146218:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.146223:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146232:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146248:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35e00) 00010000:00010000:1.0:1789131281.146252:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.146257:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146265:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879045fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146279:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146286:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146293:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146304:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.146308:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146315:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146341:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0c47f35b00) 00010000:00010000:1.0:1789131281.146343:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.146347:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146353:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904601 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146402:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879045f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ba expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146418:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ba expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.146427:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131281.146429:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131281.146432:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7600, rc 0) 00000100:00100000:1.0:1789131281.146524:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:9883:x1876039893535744:12345-192.168.203.52@tcp:101:chown.0 Request processed in 3200us (3465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.146537:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1789131281.152235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.152411:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536000 00000100:00100000:1.0:1789131281.152440:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536000 00000100:00100000:1.0:1789131281.152816:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1789131281.152829:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:9883:x1876039893536000:12345-192.168.203.52@tcp:36:chown.0 00010000:00010000:1.0:1789131281.152901:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131281.152935:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395ba expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.153010:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131281.153022:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131281.153054:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.153070:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.153082:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131281.207929:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789131281.208018:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ea4ecda9 reply state 00000000d56d3997 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131281.208031:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789131281.208170:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:0.0:1789131281.208272:0:8131:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789131281.208292:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9883:x1876039893536000:12345-192.168.203.52@tcp:36:chown.0 Request processed in 55462us (56067us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789131281.208301:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00010000:00010000:0.0:1789131281.208349:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208358:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208365:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208383:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131281.208388:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208397:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208413:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35b00) 00010000:00010000:0.0:1789131281.208416:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131281.208421:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131281.208427:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790460f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131281.227446:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131281.227528:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536128 00000100:00100000:3.0:1789131281.227547:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536128 00000100:00100000:3.0:1789131281.227609:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1789131281.227619:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:9884:x1876039893536128:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:3.0:1789131281.227643:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131281.227675:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de37187904616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395c1 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131281.229816:0:9425:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2092us 00010000:00010000:1.0:1789131281.246495:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.246515:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.246526:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.246645:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.246653:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.246668:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.247151:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.247160:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.247168:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.247232:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789131281.247235:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131281.248262:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248280:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248287:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248293:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248299:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.248303:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248310:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248442:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35e00) 00010000:00010000:1.0:1789131281.248446:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.248451:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248458:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790461d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248471:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248477:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248483:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248488:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.248491:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248496:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248503:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131281.248505:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.248508:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248513:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904624 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248671:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de37187904616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c1 expref: 8 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248685:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c1 expref: 7 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.248692:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.248694:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789131281.248696:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7800, rc 0) 00000100:00100000:1.0:1789131281.248802:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9884:x1876039893536128:12345-192.168.203.52@tcp:101:touch.500 Request processed in 21183us (21363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.248812:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1789131281.252523:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.252714:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536384 00000100:00100000:1.0:1789131281.252723:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536384 00000100:00100000:1.0:1789131281.252814:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1789131281.252824:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:9884:x1876039893536384:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:1.0:1789131281.252909:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.252929:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904632 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395c8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253224:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253233:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253313:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253360:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.253369:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131281.254472:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789131281.254934:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de37187904647 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.254946:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de37187904647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.254956:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de37187904647 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.254989:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.254996:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255002:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255007:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.255011:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255030:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255043:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.255046:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.255050:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255056:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904639 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131281.255068:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000050baea2b reply state 0000000021049510 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131281.255076:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789131281.255110:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904632 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c8 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255127:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de37187904647 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c8 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.255134:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c47f35900) 00010000:00010000:1.0:1789131281.255136:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131281.255139:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fd600, rc 0) 00000100:00100000:1.0:1789131281.255253:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:9884:x1876039893536384:12345-192.168.203.52@tcp:101:touch.500 Request processed in 2430us (2738us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789131281.255263:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1789131281.259820:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.260779:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536640 00000100:00100000:1.0:1789131281.260800:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536640 00000100:00100000:1.0:1789131281.260966:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1789131281.260977:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:9884:x1876039893536640:12345-192.168.203.52@tcp:36:touch.500 00010000:00010000:1.0:1789131281.261035:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131281.261060:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de37187904647 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c8 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.261076:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c47f35900) 00010000:00010000:1.0:1789131281.261086:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131281.261124:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.261137:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.261147:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131281.261269:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000dd46d050 reply state 00000000690b1879 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131281.261278:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131281.261393:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:9884:x1876039893536640:12345-192.168.203.52@tcp:36:touch.500 Request processed in 418us (1581us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789131281.261400:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:2.0:1789131281.261461:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261469:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261476:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261482:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.261486:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261494:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261505:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9c0c47f35600) 00010000:00010000:2.0:1789131281.261515:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131281.261520:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.261526:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904640 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131281.264302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1789131281.264408:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264435:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264443:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264449:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131281.264454:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264462:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264477:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:3.0:1789131281.264480:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131281.264484:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.264490:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de37187904655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131281.264615:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536768 00000100:00100000:2.0:1789131281.264624:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536768 00000100:00100000:2.0:1789131281.264681:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1789131281.264691:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:9884:x1876039893536768:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1789131281.264714:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131281.264743:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea200/0x9f0de3718790465c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395cf expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.264799:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea200/0x9f0de3718790465c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395cf expref: 10 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.264811:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea200/0x9f0de3718790465c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395cf expref: 10 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.264826:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c5855bd00) 00010000:00010000:2.0:1789131281.265020:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131281.265023:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea200, rc 0) 00000100:00100000:2.0:1789131281.265073:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:9884:x1876039893536768:12345-192.168.203.52@tcp:101:touch.500 Request processed in 383us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131281.265081:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1789131281.268902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131281.269032:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893536896 00000100:00100000:2.0:1789131281.269041:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893536896 00000100:00100000:2.0:1789131281.269106:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1789131281.269114:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876039893536896:12345-192.168.203.52@tcp:8:touch.500 00010000:00080000:2.0:1789131281.269147:0:6705:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 293 last 0 00000020:00000080:2.0:1789131281.269174:0:6705:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de37187904663 00002000:00100000:2.0:1789131281.269184:0:6705:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17aefd58-d436-480c-8fa4-256f2e59c9d4/ffff9c0c7aa43800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131281.269194:0:6705:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789131281.269441:0:6705:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789131281.269472:0:6705:0:(import.c:65:import_set_state_nolock()) ffff9c0c7aa40800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131281.269542:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893536896:12345-192.168.203.52@tcp:8:touch.500 Request processed in 419us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131281.269549:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1789131281.272640:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131281.272752:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893537024 00000100:00100000:2.0:1789131281.272762:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893537024 00000100:00100000:2.0:1789131281.272839:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1789131281.272849:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:0:x1876039893537024:12345-192.168.203.52@tcp:2:touch.500 00000100:00080000:1.0:1789131281.273496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1789131281.309109:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1789131281.309125:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000100:00100000:2.0:1789131281.309277:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:0:x1876039893537024:12345-192.168.203.52@tcp:2:touch.500 Request processed in 36424us (36640us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789131281.309290:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1789131281.312128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131281.312217:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893537280 00000100:00100000:3.0:1789131281.312227:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893537280 00000100:00100000:3.0:1789131281.312313:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1789131281.312340:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:9884:x1876039893537280:12345-192.168.203.52@tcp:35:touch.500 00000100:00100000:3.0:1789131281.312741:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:9884:x1876039893537280:12345-192.168.203.52@tcp:35:touch.500 Request processed in 418us (620us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789131281.312749:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1789131281.326582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.327098:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893537408 00000100:00100000:1.0:1789131281.327121:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893537408 00000100:00100000:1.0:1789131281.327183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1789131281.327193:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:9885:x1876039893537408:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1789131281.327217:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.327237:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de3718790466a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395d6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327414:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327426:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327437:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.327491:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1789131281.327495:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131281.327534:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327560:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de3718790466a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395d6 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327578:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395d6 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.327586:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.327589:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131281.327593:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc000, rc 0) 00000100:00100000:1.0:1789131281.327926:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:9885:x1876039893537408:12345-192.168.203.52@tcp:101:rm.0 Request processed in 734us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.327934:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1789131281.340233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.340515:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893537664 00000100:00100000:1.0:1789131281.340525:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893537664 00000100:00100000:1.0:1789131281.340588:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1789131281.340598:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:9885:x1876039893537664:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1789131281.340617:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.340637:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395dd expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.340775:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789131281.340896:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904678 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395dd expref: 14 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.340910:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35e00) 00010000:00010000:1.0:1789131281.340913:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131281.340917:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395dd expref: 14 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.340930:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fda00, rc 0) 00000100:00100000:1.0:1789131281.340989:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:9885:x1876039893537664:12345-192.168.203.52@tcp:101:rm.0 Request processed in 392us (764us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1789131281.340996:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1789131281.345631:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.345755:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893537792 00000100:00100000:1.0:1789131281.345765:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893537792 00000100:00100000:1.0:1789131281.345815:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1789131281.345824:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:9885:x1876039893537792:12345-192.168.203.52@tcp:37:rm.0 00000100:00100000:1.0:1789131281.349874:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:9885:x1876039893537792:12345-192.168.203.52@tcp:37:rm.0 Request processed in 4039us (4239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.349887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1789131281.353702:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131281.353794:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893538048 00000100:00100000:3.0:1789131281.353815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893538048 00000100:00100000:3.0:1789131281.353942:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1789131281.353952:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:9885:x1876039893538048:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:3.0:1789131281.354278:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493db450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:9885:x1876039893538048:12345-192.168.203.52@tcp:35:rm.0 Request processed in 326us (583us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789131281.354286:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131281.364189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.366314:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893538304 00000100:00100000:1.0:1789131281.366347:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893538304 00000100:00100000:1.0:1789131281.366461:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1789131281.366471:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:9885:x1876039893538304:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1789131281.366495:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131281.366517:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904686 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395e4 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.366634:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc600/0x9f0de3718790468d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.366648:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc600/0x9f0de3718790468d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.366658:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc600/0x9f0de3718790468d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131281.366669:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1789131281.366799:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904686 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395e4 expref: 17 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.366818:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc600/0x9f0de3718790468d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395e4 expref: 16 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.366836:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.366852:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131281.366856:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc600, rc 0) 00000100:00100000:1.0:1789131281.366919:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893538304:12345-192.168.203.52@tcp:101:rm.0 Request processed in 450us (2738us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789131281.366926:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1789131281.370607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.370676:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893538432 00000100:00100000:1.0:1789131281.370688:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893538432 00000100:00100000:1.0:1789131281.370769:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1789131281.370780:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893538432:12345-192.168.203.52@tcp:41:rm.0 00000004:00000024:1.0:1789131281.370838:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789131281.370917:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893538432:12345-192.168.203.52@tcp:41:rm.0 Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131281.370925:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:0.0:1789131281.377463:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131281.377691:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893538560 00000100:00100000:3.0:1789131281.377703:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893538560 00000100:00100000:3.0:1789131281.377787:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1789131281.377799:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893538560:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:3.0:1789131281.377827:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131281.377855:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de3718790469b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.377951:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.377971:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.377983:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.377997:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.378001:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.378005:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.378917:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.378931:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379083:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131281.379138:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789131281.379143:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131281.379170:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379185:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379195:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379201:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379209:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379215:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fc00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.379220:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379228:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379243:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:2.0:1789131281.379247:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131281.379253:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379259:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879046a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379288:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379294:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379301:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379306:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.379308:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379314:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379774:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9c0c431fa500) 00010000:00010000:2.0:1789131281.379780:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131281.379785:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.379797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879046a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.380187:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de3718790469b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395eb expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.380207:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395eb expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.380229:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c5855bd00) 00010000:00010000:2.0:1789131281.380232:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131281.380235:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb400, rc 0) 00000100:00100000:2.0:1789131281.380524:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:9885:x1876039893538560:12345-192.168.203.52@tcp:101:rm.0 Request processed in 2725us (3075us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131281.380536:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1789131281.384137:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.384228:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893538816 00000100:00100000:1.0:1789131281.384244:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893538816 00000100:00100000:1.0:1789131281.384473:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1789131281.384486:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:9885:x1876039893538816:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:1.0:1789131281.384535:0:9425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131281.384561:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879046b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395eb expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384583:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea200/0x9f0de3718790465c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395cf expref: 16 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384593:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c5855bd00) 00010000:00010000:1.0:1789131281.384608:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904671 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395d6 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384637:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.384640:0:9425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131281.384660:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384672:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384680:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384694:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384700:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384706:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384835:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384842:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.384849:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131281.388256:0:9425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789131281.388274:0:9425:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293361951771ns, next at 294361948279ns, rc = 0 00010000:00010000:1.0:1789131281.390300:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390316:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390341:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390350:0:9425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390358:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390364:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390392:0:9425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131281.390412:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390418:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390425:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390431:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.390436:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390444:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390465:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:3.0:1789131281.390468:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131281.390469:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789131281.390476:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390483:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390485:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390522:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131281.390536:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390539:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390553:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390584:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390586:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390604:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.390611:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390619:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390621:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:3.0:1789131281.390631:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131281.390634:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:3.0:1789131281.390637:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390640:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.390646:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390656:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de371879046cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.390660:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131281.390696:0:9425:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000002001816 reply state 00000000c1c30eba transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.390701:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131281.390705:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131281.390709:0:9425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789131281.390711:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131281.390796:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893538816:12345-192.168.203.52@tcp:36:rm.0 Request processed in 6309us (6784us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789131281.390807:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00010000:00010000:1.0:1789131281.395134:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395153:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395161:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395168:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131281.395173:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395182:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395199:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xd330548c (ffff9c0c47f35900) 00010000:00010000:1.0:1789131281.395202:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131281.395207:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.395214:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xd330548c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131281.399146:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.399223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539072 00000100:00100000:1.0:1789131281.399236:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539072 00000100:00100000:1.0:1789131281.399310:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1789131281.399363:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:9885:x1876039893539072:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:1.0:1789131281.399611:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893539072:12345-192.168.203.52@tcp:35:rm.0 Request processed in 292us (481us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789131281.399619:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131281.402768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131281.402935:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539328 00000100:00100000:1.0:1789131281.402945:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539328 00000100:00100000:1.0:1789131281.403013:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1789131281.403024:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:9885:x1876039893539328:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:1.0:1789131281.403075:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131281.403100:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc600/0x9f0de3718790468d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395e4 expref: 16 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403119:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790462b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395c1 expref: 15 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403129:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35800) 00010000:00010000:1.0:1789131281.403143:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de371879045ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395b3 expref: 14 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403151:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35e00) 00010000:00010000:1.0:1789131281.403157:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131281.403180:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403199:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403208:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403221:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403228:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403235:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403763:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403773:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131281.403781:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131281.405677:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1789131281.405698:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405707:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405715:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405721:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.405735:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405744:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405928:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:2.0:1789131281.405933:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789131281.405939:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405957:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd200/0x9f0de371879046e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405983:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405990:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405995:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.405999:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131281.406068:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.406076:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.406086:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c47f35900) 00010000:00010000:2.0:1789131281.406088:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131281.406091:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131281.406097:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fd600/0x9f0de371879046d3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131281.406110:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000143842e2 reply state 0000000098b7a5d3 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131281.406119:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131281.406314:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:9885:x1876039893539328:12345-192.168.203.52@tcp:36:rm.0 Request processed in 3224us (3486us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789131281.406348:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00010000:00010000:3.0:1789131281.412279:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412303:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412311:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412385:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131281.412391:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412401:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412423:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c0c47f35100) 00010000:00010000:3.0:1789131281.412426:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131281.412432:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131281.412439:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de371879046da lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131282.009664:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131283.033470:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131283.206686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131283.206738:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131283.206763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131283.206784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131283.206840:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539456 00000100:00100000:2.0:1789131283.206849:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539456 00000100:00100000:2.0:1789131283.206906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:2.0:1789131283.206916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893539456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131283.206984:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893539456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131283.206991:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:2.0:1789131283.207023:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539584 00000100:00100000:2.0:1789131283.207027:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539584 00000100:00100000:2.0:1789131283.207061:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539840 00000100:00100000:2.0:1789131283.207064:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539840 00000100:00100000:2.0:1789131283.207084:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1789131283.207091:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2352:x1876039893539584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131283.207126:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2352:x1876039893539584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131283.207133:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1789131283.207144:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1789131283.207150:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893539840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131283.207175:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893539840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131283.207181:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1789131283.207199:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539712 00000100:00100000:2.0:1789131283.207215:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539712 00000100:00100000:2.0:1789131283.207244:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1789131283.207250:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893539712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131283.207279:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893539712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131283.207285:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00080000:2.0:1789131283.207444:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131283.207449:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131283.930680:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131283.930705:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910350720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131283.930781:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131283.930903:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350720 00000100:00100000:3.0:1789131283.930911:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350720 00000100:00100000:3.0:1789131283.930962:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789131283.930971:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910350720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131283.931002:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131283.931044:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910350720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131283.931051:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1789131283.931069:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131283.931094:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c772c5e00 x1876039910350720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131283.931111:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910350720:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789131284.057530:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131285.087006:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789131285.402499:0:12035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1789131285.473956:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910350848:0@lo:400:kworker.0 00000100:00100000:0.0:1789131285.474025:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131285.474308:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131285.474315:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910350976:0@lo:400:kworker.0 00000100:00100000:0.0:1789131285.476422:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131285.476474:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350848 00000100:00100000:0.0:1789131285.476480:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350848 00000100:00100000:0.0:1789131285.476521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789131285.476529:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910350848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131285.476576:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910350848:12345-0@lo:400:kworker.0 Request processed in 48us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131285.476583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789131285.476636:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910350848:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.477158:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910350976 00000100:00100000:2.0:1789131285.477163:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910350976 00000100:00100000:2.0:1789131285.477198:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789131285.477205:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.477257:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910350976:12345-0@lo:400:kworker.0 Request processed in 53us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131285.477263:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789131285.477292:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910350976:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.480457:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910351232:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.480522:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131285.480564:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131285.480570:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910351104:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.480727:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131285.480764:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351232 00000100:00100000:2.0:1789131285.480777:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351232 00000100:00100000:2.0:1789131285.480825:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131285.480834:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910351232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.480882:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910351232:12345-0@lo:400:kworker.0 Request processed in 50us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131285.480889:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131285.480911:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351104 00000100:00100000:2.0:1789131285.480914:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351104 00000100:00100000:2.0:1789131285.480937:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789131285.480943:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910351104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.480971:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910351104:12345-0@lo:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131285.480977:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789131285.481015:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910351104:0@lo:400:kworker.0 00010000:00080000:2.0:1789131285.481028:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a7f4780 x1876039910351232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131285.481038:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910351232:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.481061:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910351360:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.481084:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131285.481101:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131285.481106:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910351488:0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.481125:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131285.481149:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351488 00000100:00100000:2.0:1789131285.481152:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351488 00000100:00100000:2.0:1789131285.481174:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789131285.481179:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910351488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131285.481215:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910351488:12345-0@lo:400:kworker.0 Request processed in 36us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131285.481221:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789131285.481245:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a7f6580 x1876039910351488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131285.481253:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910351488:0@lo:400:kworker.0 00000100:00080000:3.0:1789131285.481354:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131285.481359:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131285.481361:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131285.481370:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351360 00000100:00100000:3.0:1789131285.481373:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351360 00000100:00100000:3.0:1789131285.481409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789131285.481416:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910351360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131285.481464:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910351360:12345-0@lo:400:kworker.0 Request processed in 49us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131285.481470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789131285.481498:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910351360:0@lo:400:kworker.0 00000100:00080000:2.0:1789131285.481714:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1789131285.977560:0:7941:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297951234666ns, next at 298951231945ns, rc = 0 00000100:00100000:3.0:1789131285.977685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910351616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131285.977772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131285.977857:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351616 00000100:00100000:2.0:1789131285.977866:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351616 00000100:00100000:3.0:1789131285.977953:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789131285.977964:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910351616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131285.978003:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131285.978059:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910351616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131285.978067:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1789131285.978116:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a5a0000 x1876039910351616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131285.978132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910351616:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131286.105521:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789131286.566193:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1789131286.566216:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1789131286.566226:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1789131286.566374:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910351744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789131286.566434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131286.566700:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351744 00000100:00100000:1.0:1789131286.566720:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351744 00000100:00100000:1.0:1789131286.566807:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789131286.566816:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910351744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789131286.566850:0:8327:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789131286.566883:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3fa11, atime: 0x6aa3fa11, ctime: 0x6aa3fa11, blocks: 0x1 00010000:00010000:1.0:1789131286.566891:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.566906:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=298s v=(0 0) 00010000:00010000:1.0:1789131286.566910:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131286.566916:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.566934:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.566944:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.566951:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.567096:0:8327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789131286.567767:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910351744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 949us (1328us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789131286.567776:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1789131286.568101:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c7a7f43c0/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789131286.568108:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910351744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789131286.568477:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131286.568491:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.568623:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131286.568628:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.568637:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.568656:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.568664:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de371879046e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.568683:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131286.568684:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131286.568686:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789131286.666787:0:12085:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8b15fa70 20000000:00000080:1.0:1789131286.666804:0:12085:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c7aa55400 uarg=0000000000000000 20000000:01000000:1.0:1789131286.666902:0:12085:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789131286.666909:0:12085:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789131286.666914:0:12085:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789131286.669965:0:12086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789131286.670134:0:12085:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789131286.676706:0:12085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789131286.676786:0:12085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10256 00000040:00080000:1.0:1789131286.676859:0:12085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10480 10000000:01000000:1.0:1789131286.676885:0:12085:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789131286.676904:0:12085:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676924:0:12085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676932:0:12085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676939:0:12085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904598 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676945:0:12085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879045a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676951:0:12085:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879045b4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676957:0:12085:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.676994:0:12085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.677008:0:12085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 18 pid: 5838 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.677021:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910351872:0@lo:104: 00000100:00100000:1.0:1789131286.677078:0:12085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131286.677139:0:12085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.677154:0:12085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 18 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.677162:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352000:0@lo:104: 00000100:00100000:1.0:1789131286.677187:0:12085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131286.677219:0:12085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.677226:0:12085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 18 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.677234:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352128:0@lo:104: 00000100:00100000:1.0:1789131286.677254:0:12085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789131286.677273:0:12085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.677283:0:12085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.677293:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352256:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131286.677488:0:12085:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.677496:0:12085:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.677505:0:12085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352384:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131286.677533:0:12085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b42e9f780 going to sleep for 11 seconds 00000100:00100000:0.0:1789131286.677756:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910351872 00000100:00100000:0.0:1789131286.677764:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910351872 00000100:00100000:0.0:1789131286.677800:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352000 00000100:00100000:0.0:1789131286.677804:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352000 00000100:00100000:0.0:1789131286.677824:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352128 00000100:00100000:0.0:1789131286.677834:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352128 00000100:00100000:0.0:1789131286.677854:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131286.677861:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:12085:x1876039910351872:12345-0@lo:104: 00010000:00010000:0.0:1789131286.677873:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.677933:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131286.677939:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+5:12085:x1876039910351872:12345-0@lo:104: Request processed in 79us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.677945:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131286.677964:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789131286.677970:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:12085:x1876039910352000:12345-0@lo:104: 00010000:00010000:0.0:1789131286.677977:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678010:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789131286.678015:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+4:12085:x1876039910352000:12345-0@lo:104: Request processed in 46us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.678021:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789131286.678033:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789131286.678038:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:12085:x1876039910352128:12345-0@lo:104: 00010000:00010000:0.0:1789131286.678045:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678075:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789131286.678080:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+3:12085:x1876039910352128:12345-0@lo:104: Request processed in 42us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.678085:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789131286.678133:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789131286.678139:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678146:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131286.678150:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678159:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131286.678166:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131286.678173:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131286.678200:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678206:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131286.678225:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678232:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de371879045b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045bb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678244:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131286.678247:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678252:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131286.678255:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678268:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131286.678274:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131286.678279:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131286.678293:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678298:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131286.678304:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678310:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceb000/0x9f0de371879045a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879045ad expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678319:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131286.678344:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678350:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131286.678353:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678359:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131286.678365:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131286.678376:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789131286.678390:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678395:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131286.678408:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678414:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c7473f600/0x9f0de37187904598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790459f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678428:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131286.678429:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131286.678431:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131286.678437:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131286.678451:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131286.678461:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910352768:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131286.678491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131286.678533:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352768 00000100:00100000:0.0:1789131286.678537:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352768 00010000:00010000:0.0:1789131286.678558:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131286.678578:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131286.678583:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910352768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131286.678592:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131286.678596:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678615:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 19 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.678630:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131286.678659:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910352768:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.678666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131286.678712:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910352768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131286.678919:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131286.678949:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910351872:0@lo:104: 00000100:00100000:1.0:1789131286.678958:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352000:0@lo:104: 00010000:00010000:1.0:1789131286.678967:0:12085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41cea400/0x9f0de3718790459f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187904598 expref: 18 pid: 5839 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.678977:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352128:0@lo:104: 00000100:00100000:2.0:1789131286.679380:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910352512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131286.679416:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131286.679450:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131286.679456:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910352640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131286.679478:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131286.679755:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352512 00000100:00100000:0.0:1789131286.679761:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352512 00010000:00010000:0.0:1789131286.679784:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 18 pid: 5838 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131286.679899:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352640 00000100:00100000:0.0:1789131286.679903:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352640 00010000:00010000:0.0:1789131286.679917:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 19 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131286.679934:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131286.679941:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910352512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131286.679951:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131286.679955:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 19 pid: 5838 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.679967:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 19 pid: 5838 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.679982:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceba00/0x9f0de371879045bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879045b4 expref: 19 pid: 5838 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.680003:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131286.680039:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3308:x1876039910352512:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.680047:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789131286.680062:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131286.680068:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3308:x1876039910352640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131286.680076:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131286.680080:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.680090:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.680100:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41cea800/0x9f0de371879045ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879045a6 expref: 17 pid: 5837 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.680108:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131286.680132:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3308:x1876039910352640:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.680139:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789131286.680173:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910352640:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131286.680181:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910352512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131286.688708:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352256:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131286.695544:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131286.696799:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893539968 00000100:00100000:0.0:1789131286.696814:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893539968 00010000:00010000:0.0:1789131286.696873:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131286.696929:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1789131286.696939:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893539968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131286.696953:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131286.696960:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.696971:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.696990:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e14200/0x9f0de37187904591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395a5 expref: 13 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.697007:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131286.697079:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa19e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:2353:x1876039893539968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 142us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131286.697087:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1789131286.705698:0:12085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:12085:1876039910352384:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131286.705742:0:12085:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131286.707453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131286.707565:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540096 00000100:00100000:1.0:1789131286.707573:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540096 00010000:00010000:1.0:1789131286.707613:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131286.707667:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1789131286.707678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:2353:x1876039893540096:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131286.707702:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131286.707709:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707721:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707742:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15200/0x9f0de3718790458a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03959e expref: 12 pid: 5839 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707759:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707768:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707803:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707810:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707828:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707836:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707843:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131286.707847:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707855:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707868:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131286.707880:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131286.707945:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2353:x1876039893540096:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 268us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131286.707953:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:0.0:1789131286.708532:0:12085:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.708543:0:12085:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131286.708549:0:12085:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd200/0x9f0de371879046ef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 12085 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131287.129672:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131288.153471:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789131288.153602:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131288.153607:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0b41ae9800 from 10 10000000:01000000:2.0:1789131288.153612:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131288.153660:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.153671:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.153692:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131288.153735:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910352896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.153822:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131288.153890:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131288.154101:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910352896 00000100:00100000:1.0:1789131288.154110:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910352896 00000100:00100000:1.0:1789131288.154170:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789131288.154180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:5842:x1876039910352896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131288.154201:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131288.154216:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fc600/0x9f0de371879046fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879046f6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.154238:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fc600/0x9f0de371879046fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879046f6 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.154250:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fc600/0x9f0de371879046fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879046f6 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.154259:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc600, rc 0) 00000100:00100000:1.0:1789131288.154308:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910352896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.154316:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789131288.154359:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910352896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131288.154374:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.154383:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131288.154437:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.154464:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131288.154484:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.154584:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353024 00000100:00100000:0.0:1789131288.154589:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353024 00000100:00100000:0.0:1789131288.155505:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789131288.155519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910353024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.156000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910353024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 484us (1533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.156009:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789131288.156097:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.156143:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.156186:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131288.156475:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131288.156559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353152 00000100:00100000:1.0:1789131288.156565:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353152 00000100:00100000:1.0:1789131288.156607:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1789131288.156615:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910353152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131288.157025:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910353152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 410us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.157034:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1789131288.157130:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.158995:0:12099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12099:1876039910353280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131288.159123:0:12099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131288.159236:0:12099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131288.159459:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353280 00000100:00100000:1.0:1789131288.159467:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353280 00000100:00100000:1.0:1789131288.159517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1789131288.159525:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:12099:x1876039910353280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131288.159976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:12099:x1876039910353280:12345-0@lo:502:llog_process_th.0 Request processed in 451us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.159989:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789131288.160295:0:12099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12099:1876039910353280:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131288.160347:0:12099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131288.160362:0:12099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131288.160365:0:12099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789131288.160372:0:12099:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0b41ae9800 00000020:00000080:2.0:1789131288.160374:0:12099:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789131288.160464:0:12099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12099:1876039910353408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131288.160502:0:12099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131288.160535:0:12099:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.160661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353408 00000100:00100000:0.0:1789131288.160667:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353408 00000100:00100000:0.0:1789131288.160712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789131288.160721:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:12099:x1876039910353408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131288.160932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:12099:x1876039910353408:12345-0@lo:502:llog_process_th.0 Request processed in 212us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.160939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789131288.161068:0:12099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12099:1876039910353408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131288.161088:0:12099:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131288.161093:0:12099:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131288.161095:0:12099:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789131288.161098:0:12099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789131288.161699:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789131288.161719:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131288.161731:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.161743:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131288.161753:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131288.161755:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172800 from 10 10000000:01000000:0.0:1789131288.161758:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131288.162011:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.162020:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.162029:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131288.162047:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.162086:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.162121:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131288.162742:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353536 00000100:00100000:2.0:1789131288.162750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353536 00000100:00100000:2.0:1789131288.162810:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789131288.162820:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:5842:x1876039910353536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131288.162833:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131288.164529:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceb800/0x9f0de3718790470b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904704 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.164567:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceb800/0x9f0de3718790470b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904704 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.164580:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceb800/0x9f0de3718790470b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904704 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.164590:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb800, rc 0) 00000100:00100000:2.0:1789131288.164736:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910353536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1917us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.164759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789131288.166755:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131288.166781:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.166794:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131288.166863:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.166914:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.166959:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131288.168733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353664 00000100:00100000:2.0:1789131288.168743:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353664 00000100:00100000:2.0:1789131288.168805:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1789131288.168815:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910353664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.169102:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910353664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (2186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.169109:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1789131288.169637:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.169695:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.169743:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.169787:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131288.170702:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353792 00000100:00100000:2.0:1789131288.170710:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353792 00000100:00100000:2.0:1789131288.170751:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789131288.170759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910353792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.170953:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910353792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.170961:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789131288.171146:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910353792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789131288.171492:0:12101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12101:1876039910353920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131288.171533:0:12101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131288.171568:0:12101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b42e9fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.171624:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910353920 00000100:00100000:0.0:1789131288.171635:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910353920 00000100:00100000:0.0:1789131288.171665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1789131288.171671:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:12101:x1876039910353920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131288.171956:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:12101:x1876039910353920:12345-0@lo:502:llog_process_th.0 Request processed in 283us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.171963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789131288.172714:0:12101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12101:1876039910353920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131288.172744:0:12101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131288.172754:0:12101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131288.172756:0:12101:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789131288.172763:0:12101:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43172800 00000020:00000080:1.0:1789131288.172765:0:12101:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789131288.172909:0:12101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12101:1876039910354048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131288.172953:0:12101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131288.172978:0:12101:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b42e9fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131288.173537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354048 00000100:00100000:2.0:1789131288.173544:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354048 00000100:00100000:2.0:1789131288.173579:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789131288.173587:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:12101:x1876039910354048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131288.173950:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:12101:x1876039910354048:12345-0@lo:502:llog_process_th.0 Request processed in 363us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.173959:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789131288.174579:0:12101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12101:1876039910354048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789131288.174621:0:12101:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131288.174628:0:12101:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131288.174630:0:12101:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789131288.174636:0:12101:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789131288.174942:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789131288.174962:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131288.174972:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.174983:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131288.174994:0:5842:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789131288.174997:0:5842:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43124000 from 10 10000000:01000000:0.0:1789131288.174999:0:5842:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789131288.175028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.175035:0:5842:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.175045:0:5842:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131288.175064:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.175108:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.175152:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c436c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131288.175706:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354176 00000100:00100000:1.0:1789131288.175713:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354176 00000100:00100000:1.0:1789131288.175751:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789131288.175759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:5842:x1876039910354176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131288.175870:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131288.175885:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd200/0x9f0de37187904719 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187904712 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.175916:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd200/0x9f0de37187904719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187904712 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.175927:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fd200/0x9f0de37187904719 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187904712 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.175936:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fd200, rc 0) 00000100:00100000:1.0:1789131288.175988:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c461eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910354176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 228us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.175995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789131288.176801:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131288.176821:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131288.176844:0:5842:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131288.176907:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131288.176943:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131288.176978:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.177083:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354304 00000100:00100000:0.0:1789131288.177094:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354304 00000100:00100000:0.0:1789131288.177137:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789131288.177144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910354304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.177401:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910354304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.177408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789131288.177443:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.177477:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.177514:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.177530:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.177542:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354432 00000100:00100000:0.0:1789131288.177545:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354432 00000100:00100000:0.0:1789131288.177567:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789131288.177572:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910354432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.177902:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:5842:x1876039910354432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 328us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.177909:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1789131288.177950:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:42008966-81eb-4eb4-8558-cee0fff8e6d5:5842:1876039910354432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.178109:0:12103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12103:1876039910354560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131288.178144:0:12103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131288.178164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354560 00000100:00100000:0.0:1789131288.178168:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354560 00000100:00100000:0.0:1789131288.178188:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789131288.178194:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:12103:x1876039910354560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131288.178313:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:12103:x1876039910354560:12345-0@lo:502:llog_process_th.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.178345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1789131288.178374:0:12103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c430c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.178385:0:12103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12103:1876039910354560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789131288.178406:0:12103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789131288.178415:0:12103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789131288.178417:0:12103:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789131288.178423:0:12103:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43124000 00000020:00000080:0.0:1789131288.178426:0:12103:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789131288.179399:0:12103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12103:1876039910354688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131288.179445:0:12103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131288.179473:0:12103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b42e9f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131288.182050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354688 00000100:00100000:0.0:1789131288.182062:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354688 00000100:00100000:0.0:1789131288.182120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1789131288.182130:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:12103:x1876039910354688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131288.182405:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:12103:x1876039910354688:12345-0@lo:502:llog_process_th.0 Request processed in 275us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.182413:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789131288.182535:0:12103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:42008966-81eb-4eb4-8558-cee0fff8e6d5:12103:1876039910354688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131288.182571:0:12103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131288.182579:0:12103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131288.182581:0:12103:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789131288.182587:0:12103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789131288.185749:0:5842:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789131288.185789:0:5842:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131288.185801:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131288.185814:0:5842:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131288.193584:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789131288.321977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.322020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.322060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.322117:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.322150:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540480 00000100:00100000:2.0:1789131288.322159:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540480 00000100:00100000:2.0:1789131288.322215:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1789131288.322225:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893540480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131288.322293:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893540480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.322300:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00080000:2.0:1789131288.322319:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131288.322507:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540224 00000100:00100000:1.0:1789131288.322512:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540224 00000100:00100000:1.0:1789131288.322548:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:1.0:1789131288.322555:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2352:x1876039893540224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131288.322590:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2352:x1876039893540224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.322597:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 291 00000100:00100000:0.0:1789131288.322646:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540352 00000100:00100000:0.0:1789131288.322651:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540352 00000100:00100000:0.0:1789131288.322714:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540608 00000100:00100000:0.0:1789131288.322718:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540608 00000100:00100000:0.0:1789131288.322750:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:0.0:1789131288.322767:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893540352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131288.322817:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893540352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 53us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.322824:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:0.0:1789131288.322838:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:0.0:1789131288.322844:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893540608:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131288.322869:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893540608:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (850us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.322876:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00080000:1.0:1789131288.323214:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131288.645192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131288.645463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540736 00000100:00100000:1.0:1789131288.645473:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540736 00000100:00100000:1.0:1789131288.645537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00100000:1.0:1789131288.645548:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:5592:x1876039893540736:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131288.645566:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131288.645600:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395f2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.645630:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f2 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.645642:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f2 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131288.645651:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fd600, rc 0) 00000100:00100000:1.0:1789131288.645749:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893540736:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 200us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.645756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00100000:0.0:1789131288.652258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.652345:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540864 00000100:00100000:2.0:1789131288.652355:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540864 00000100:00100000:2.0:1789131288.652409:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:2.0:1789131288.652418:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893540864:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131288.652690:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893540864:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 272us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.652698:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 293 00000100:00100000:2.0:1789131288.658223:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131288.658302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893540992 00000100:00100000:3.0:1789131288.658310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893540992 00000100:00100000:3.0:1789131288.658386:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:3.0:1789131288.658396:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893540992:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131288.659670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893540992:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 1268us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131288.659690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:2.0:1789131288.671993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131288.672609:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541120 00000100:00100000:1.0:1789131288.672620:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541120 00000100:00100000:1.0:1789131288.672688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:1.0:1789131288.672697:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:10155:x1876039893541120:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131288.672948:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:10155:x1876039893541120:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 252us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131288.672956:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 295 00000100:00100000:0.0:1789131288.695834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131288.697359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541248 00000100:00100000:3.0:1789131288.697370:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541248 00000100:00100000:3.0:1789131288.697428:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:3.0:1789131288.697439:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:10155:x1876039893541248:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131288.697728:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:10155:x1876039893541248:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 290us (1901us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131288.697736:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:3.0:1789131288.701609:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.701771:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541376 00000100:00100000:2.0:1789131288.701780:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541376 00000100:00100000:2.0:1789131288.701832:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:2.0:1789131288.701843:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:5592:x1876039893541376:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131288.701859:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131288.701876:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceb200/0x9f0de37187904727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0395f9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.701923:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceb200/0x9f0de37187904727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.701934:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceb200/0x9f0de37187904727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131288.701943:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb200, rc 0) 00000100:00100000:2.0:1789131288.702001:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893541376:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.702007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:2.0:1789131288.711427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131288.711529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541504 00000100:00100000:0.0:1789131288.711538:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541504 00000100:00100000:0.0:1789131288.711599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:0.0:1789131288.711609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893541504:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131288.711895:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893541504:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 286us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131288.711903:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 298 00000100:00100000:0.0:1789131288.715450:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131288.715776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541632 00000100:00100000:3.0:1789131288.715785:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541632 00000100:00100000:3.0:1789131288.715834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:3.0:1789131288.715843:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893541632:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131288.716689:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:5592:x1876039893541632:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 833us (1234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131288.716700:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 299 00000100:00100000:3.0:1789131288.728387:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131288.728763:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541760 00000100:00100000:2.0:1789131288.728773:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541760 00000100:00100000:2.0:1789131288.728829:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:2.0:1789131288.728838:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:10158:x1876039893541760:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131288.729136:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:10158:x1876039893541760:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 298us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131288.729145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 300 00000100:00100000:2.0:1789131288.737594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131288.737684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893541888 00000100:00100000:3.0:1789131288.737694:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893541888 00000100:00100000:3.0:1789131288.737748:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:3.0:1789131288.737757:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:10158:x1876039893541888:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131288.738013:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:10158:x1876039893541888:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 256us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131288.738022:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 301 00000100:00100000:1.0:1789131289.055609:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131289.055631:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131289.055720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131289.055914:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354816 00000100:00100000:3.0:1789131289.055922:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354816 00000100:00100000:3.0:1789131289.055984:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789131289.055994:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910354816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131289.056031:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131289.056073:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910354816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131289.056080:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1789131289.056387:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131289.056418:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4c000 x1876039910354816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131305 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131289.056435:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910354816:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131289.177855:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131289.241964:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131290.201688:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131290.587131:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355328:0@lo:400:kworker.0 00000100:00100000:3.0:1789131290.587199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131290.587270:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131290.587277:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910355200:0@lo:400:kworker.0 00000100:00100000:3.0:1789131290.587304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131290.587352:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355200 00000100:00100000:3.0:1789131290.587359:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355200 00000100:00100000:3.0:1789131290.587421:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789131290.587431:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910355200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131290.587593:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910355200:12345-0@lo:400:kworker.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131290.587601:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789131290.587643:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910355200:0@lo:400:kworker.0 00000100:00080000:1.0:1789131290.587731:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131290.588508:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910355072:0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588552:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131290.588590:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910355584:0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588615:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131290.588657:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789131290.588685:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910354944:0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588719:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131290.588740:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910355456:0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131290.588789:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355328 00000100:00100000:2.0:1789131290.588794:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355328 00000100:00100000:2.0:1789131290.588828:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355584 00000100:00100000:2.0:1789131290.588831:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355584 00000100:00100000:2.0:1789131290.588857:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789131290.588864:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910355328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588907:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910355328:12345-0@lo:400:kworker.0 Request processed in 43us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131290.588913:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789131290.588927:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789131290.588932:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910355584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131290.588962:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910355584:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131290.588969:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789131290.589005:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910355584:0@lo:400:kworker.0 00000100:00100000:0.0:1789131290.589075:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355072 00000100:00100000:0.0:1789131290.589079:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355072 00000100:00100000:0.0:1789131290.589426:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355456 00000100:00100000:0.0:1789131290.589431:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355456 00010000:00080000:3.0:1789131290.589909:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa5a1c0 x1876039910355328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131290.589922:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355328:0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590077:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789131290.590089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910355072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590148:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910355072:12345-0@lo:400:kworker.0 Request processed in 64us (1595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131290.590155:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789131290.590171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789131290.590178:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590206:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910355456:12345-0@lo:400:kworker.0 Request processed in 30us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131290.590213:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1789131290.590231:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789131290.590235:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131290.590255:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910355456:0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590267:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910355072:0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590298:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910354944 00000100:00100000:1.0:1789131290.590302:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910354944 00000100:00100000:1.0:1789131290.590346:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789131290.590353:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910354944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131290.590440:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910354944:0@lo:400:kworker.0 00000100:00100000:1.0:1789131290.590783:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c47e8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910354944:12345-0@lo:400:kworker.0 Request processed in 428us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131290.590791:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789131291.100887:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131291.100911:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131291.100987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131291.101125:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355712 00000100:00100000:2.0:1789131291.101133:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355712 00000100:00100000:3.0:1789131291.101285:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789131291.101296:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910355712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131291.101357:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131291.101410:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910355712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131291.101417:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789131291.101840:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131291.225446:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789131291.674831:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789131292.252095:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131293.274451:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131293.443360:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131293.443408:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131293.443439:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131293.443466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131293.443494:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542144 00000100:00100000:0.0:1789131293.443502:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542144 00000100:00100000:0.0:1789131293.443560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542400 00000100:00100000:0.0:1789131293.443563:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542400 00000100:00100000:0.0:1789131293.443586:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:0.0:1789131293.443595:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893542144:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131293.443675:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893542144:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131293.443683:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:0.0:1789131293.443700:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:0.0:1789131293.443706:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893542400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131293.443731:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893542400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131293.443736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00080000:1.0:1789131293.443865:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131293.444076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542016 00000100:00100000:2.0:1789131293.444082:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542016 00000100:00100000:2.0:1789131293.444116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:2.0:1789131293.444124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893542016:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131293.444153:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893542016:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131293.444165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 303 00000100:00100000:3.0:1789131293.444382:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542272 00000100:00100000:3.0:1789131293.444394:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542272 00000100:00100000:3.0:1789131293.444441:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1789131293.444461:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893542272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131293.444494:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893542272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131293.444501:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:1.0:1789131293.444608:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131294.170130:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131294.170213:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131294.170455:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355840 00000100:00100000:0.0:1789131294.170463:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355840 00000100:00100000:0.0:1789131294.170531:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789131294.170542:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910355840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131294.170585:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131294.170630:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910355840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131294.170651:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789131294.170756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789131294.170825:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4c000 x1876039910355840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131310 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131294.170912:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910355840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789131294.297549:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131295.327027:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131295.709770:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910356352:0@lo:400:kworker.0 00000100:00100000:2.0:1789131295.709839:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131295.709901:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131295.709907:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910356224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131295.709945:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131295.709979:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356352 00000100:00100000:2.0:1789131295.709985:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356352 00000100:00100000:2.0:1789131295.710026:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789131295.710034:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910356352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131295.710080:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910356352:12345-0@lo:400:kworker.0 Request processed in 46us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131295.710088:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789131295.710124:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7aa18000 x1876039910356352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131295.710137:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910356352:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710219:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910356096:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710264:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131295.710291:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910356608:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710314:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131295.710363:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789131295.710369:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910355968:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710398:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131295.710417:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910356480:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710437:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131295.710465:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356608 00000100:00100000:1.0:1789131295.710469:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356608 00000100:00100000:1.0:1789131295.710501:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789131295.710509:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910356608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710545:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910356608:12345-0@lo:400:kworker.0 Request processed in 37us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131295.710552:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789131295.710570:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910355968 00000100:00100000:1.0:1789131295.710573:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910355968 00000100:00100000:1.0:1789131295.710594:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789131295.710600:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910355968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710639:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910355968:12345-0@lo:400:kworker.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131295.710645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789131295.710670:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356224 00000100:00100000:1.0:1789131295.710673:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356224 00000100:00100000:1.0:1789131295.710708:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356096 00000100:00100000:1.0:1789131295.710711:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356096 00000100:00100000:1.0:1789131295.710724:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356480 00000100:00100000:1.0:1789131295.710726:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356480 00000100:00100000:1.0:1789131295.710740:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789131295.710747:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910356224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710781:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910356224:12345-0@lo:400:kworker.0 Request processed in 35us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131295.710787:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789131295.710799:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789131295.710805:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910356096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710831:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910356096:12345-0@lo:400:kworker.0 Request processed in 26us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131295.710836:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789131295.710847:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789131295.710855:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710882:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910356480:12345-0@lo:400:kworker.0 Request processed in 28us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131295.710887:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789131295.710916:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910355968:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710928:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910356480:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710936:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910356096:0@lo:400:kworker.0 00000100:00100000:1.0:1789131295.710944:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1789131295.710947:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c7a7f43c0, transno 4294967300 00000100:00100000:1.0:1789131295.710959:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910356608:0@lo:400:kworker.0 00000100:00080000:2.0:1789131295.713949:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789131295.713959:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131295.714013:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910356224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131296.221612:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131296.221651:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910356736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131296.221716:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131296.221791:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356736 00000100:00100000:2.0:1789131296.221799:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356736 00000100:00100000:2.0:1789131296.221860:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789131296.221869:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910356736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131296.221906:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131296.221962:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910356736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131296.221970:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789131296.222021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910356736:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131296.345485:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131297.369596:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131298.393968:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131298.565035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131298.565144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131298.566914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131298.566965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131298.567099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542528 00000100:00100000:3.0:1789131298.567108:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542528 00000100:00100000:3.0:1789131298.567173:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:3.0:1789131298.567184:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893542528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131298.567251:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893542528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131298.567259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 305 00000100:00100000:3.0:1789131298.567305:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542784 00000100:00100000:3.0:1789131298.567309:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542784 00000100:00100000:3.0:1789131298.567365:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1789131298.567373:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893542784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131298.567402:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893542784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131298.567408:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00080000:3.0:1789131298.567432:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131298.567910:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542656 00000100:00100000:1.0:1789131298.567917:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542656 00000100:00100000:1.0:1789131298.568021:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893542912 00000100:00100000:1.0:1789131298.568025:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893542912 00000100:00080000:3.0:1789131298.568051:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131298.568159:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1789131298.568167:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893542656:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131298.568208:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893542656:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131298.568215:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1789131298.568229:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:1.0:1789131298.568236:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893542912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131298.568259:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893542912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (3115us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131298.568265:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:1.0:1789131299.290029:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131299.290051:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910356864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131299.290117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131299.290350:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356864 00000100:00100000:0.0:1789131299.290359:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356864 00000100:00100000:0.0:1789131299.290455:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789131299.290465:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910356864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131299.290497:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131299.290541:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910356864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131299.290548:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789131299.290611:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c55b4c780 x1876039910356864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131315 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131299.290630:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910356864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131299.294400:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789131299.417489:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131299.483370:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131300.441502:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131300.825572:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789131300.825610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910357248:0@lo:400:kworker.0 00000100:00100000:2.0:1789131300.825680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131300.825870:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910356992:0@lo:400:kworker.0 00000100:00100000:0.0:1789131300.825907:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131300.825999:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910357120:0@lo:400:kworker.0 00000100:00100000:3.0:1789131300.826019:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131300.826032:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910357376:0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.826037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131300.826074:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131300.826083:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357248 00000100:00100000:2.0:1789131300.826092:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357248 00000100:00100000:0.0:1789131300.831758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910356992 00000100:00100000:0.0:1789131300.831776:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910356992 00000100:00100000:0.0:1789131300.831850:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789131300.831860:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910356992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131300.831956:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910356992:12345-0@lo:400:kworker.0 Request processed in 96us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131300.831964:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789131300.832017:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910356992:0@lo:400:kworker.0 00000100:00100000:0.0:1789131300.832065:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357120 00000100:00100000:0.0:1789131300.832069:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357120 00000100:00100000:1.0:1789131300.834650:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357376 00000100:00100000:1.0:1789131300.834666:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357376 00000100:00100000:1.0:1789131300.834736:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789131300.834747:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910357376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.834843:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910357376:12345-0@lo:400:kworker.0 Request processed in 98us (8768us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131300.834866:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1789131300.834907:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131300.835000:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910357632:0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.835037:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131300.835062:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131300.835068:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910357504:0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.835092:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131300.835113:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357504 00000100:00100000:1.0:1789131300.835117:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357504 00000100:00100000:2.0:1789131300.836399:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789131300.836417:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910357248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131300.836480:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910357248:12345-0@lo:400:kworker.0 Request processed in 72us (10799us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131300.836488:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789131300.839070:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789131300.839091:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910357120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131300.839177:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910357120:12345-0@lo:400:kworker.0 Request processed in 96us (13142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131300.839185:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789131300.839269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910357120:0@lo:400:kworker.0 00000100:00080000:0.0:1789131300.839300:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131300.839350:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa183c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910357248:0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.840976:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789131300.840998:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131300.841081:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910357504:12345-0@lo:400:kworker.0 Request processed in 95us (5988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131300.841089:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789131300.841139:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910357504:0@lo:400:kworker.0 00000100:00100000:2.0:1789131300.841286:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357632 00000100:00100000:2.0:1789131300.841294:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357632 00000100:00100000:2.0:1789131300.841358:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789131300.841367:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910357632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131300.841407:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910357632:12345-0@lo:400:kworker.0 Request processed in 42us (6369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131300.841414:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1789131300.843637:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131300.843695:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910357632:0@lo:400:kworker.0 00010000:00080000:3.0:1789131300.844748:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43dec000 x1876039910357376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789131300.844763:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910357376:0@lo:400:kworker.0 00000100:00100000:0.0:1789131301.337623:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131301.337655:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910357760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131301.337728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131301.337918:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357760 00000100:00100000:1.0:1789131301.337926:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357760 00000100:00100000:1.0:1789131301.337975:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789131301.337985:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910357760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131301.338019:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131301.338071:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910357760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131301.338078:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131301.338504:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910357760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789131301.466096:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131302.489638:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131303.513691:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131303.690869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131303.690917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131303.691006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543040 00000100:00100000:1.0:1789131303.691016:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543040 00000100:00100000:1.0:1789131303.691072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:1.0:1789131303.691082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893543040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131303.691148:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893543040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131303.691150:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543168 00000100:00100000:2.0:1789131303.691157:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543168 00000100:00100000:1.0:1789131303.691161:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 307 00000100:00100000:2.0:1789131303.691208:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00080000:1.0:1789131303.691208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131303.691220:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893543168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131303.691252:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893543168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131303.691258:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1789131303.701168:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131303.703211:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131303.703299:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543424 00000100:00100000:2.0:1789131303.703309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543424 00000100:00100000:2.0:1789131303.703403:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1789131303.703413:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893543424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131303.703494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893543424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131303.703502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:1.0:1789131303.704066:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543296 00000100:00100000:1.0:1789131303.704073:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543296 00000100:00100000:1.0:1789131303.704124:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1789131303.704133:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2351:x1876039893543296:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:1.0:1789131303.704152:0:6706:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904663 00000100:00080000:1.0:1789131303.704161:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0c7aa40800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131303.704200:0:6706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1789131303.705606:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+2:2351:x1876039893543296:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 1466us (4438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131303.705619:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:1.0:1789131303.705655:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131303.706393:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131303.706400:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131304.411085:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131304.411106:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910357888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131304.411177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131304.413845:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910357888 00000100:00100000:0.0:1789131304.413861:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910357888 00000100:00100000:0.0:1789131304.413955:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789131304.413967:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910357888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131304.414018:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131304.414114:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910357888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (2937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131304.414121:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789131304.414403:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43dec000 x1876039910357888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131304.414425:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43dec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910357888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131304.414498:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789131304.538359:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131305.561692:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131305.945756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910358272:0@lo:400:kworker.0 00000100:00100000:3.0:1789131305.945831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131305.945842:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910358016:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.945890:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131305.945912:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131305.945922:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358400:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.945928:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910358528:0@lo:400:kworker.0 00000100:00100000:3.0:1789131305.945978:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131305.945980:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131305.946010:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789131305.946019:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910358144:0@lo:400:kworker.0 00000100:00100000:3.0:1789131305.946042:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358016 00000100:00100000:0.0:1789131305.946045:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131305.946051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358016 00000100:00100000:0.0:1789131305.946064:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910358656:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.946090:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131305.946098:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789131305.946110:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910358016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131305.946173:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358272 00000100:00100000:1.0:1789131305.946179:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358272 00000100:00100000:3.0:1789131305.946189:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910358016:12345-0@lo:400:kworker.0 Request processed in 81us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131305.946198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1789131305.946222:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358528 00000100:00100000:1.0:1789131305.946226:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358528 00000100:00100000:1.0:1789131305.946247:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358144 00000100:00100000:1.0:1789131305.946249:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358144 00000100:00100000:1.0:1789131305.946261:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789131305.946267:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910358272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131305.946319:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910358272:12345-0@lo:400:kworker.0 Request processed in 52us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131305.946345:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789131305.946359:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789131305.946366:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910358528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131305.946392:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910358528:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131305.946397:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789131305.946408:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789131305.946414:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910358144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131305.946439:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910358144:12345-0@lo:400:kworker.0 Request processed in 26us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131305.946445:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1789131305.946461:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131305.946488:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910358272:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.946570:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910358144:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.946591:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c5684a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910358016:0@lo:400:kworker.0 00000100:00100000:2.0:1789131305.946658:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358400 00000100:00100000:2.0:1789131305.946662:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358400 00000100:00100000:0.0:1789131305.946697:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910358528:0@lo:400:kworker.0 00000100:00100000:2.0:1789131305.946854:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358656 00000100:00100000:2.0:1789131305.946858:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358656 00000100:00100000:0.0:1789131305.947685:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789131305.947699:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.947779:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358400:12345-0@lo:400:kworker.0 Request processed in 85us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131305.947787:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789131305.947805:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789131305.947811:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910358656:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789131305.947888:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789131305.948034:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7a7f43c0 x1876039910358400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131305.948048:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358400:0@lo:400:kworker.0 00000100:00100000:1.0:1789131305.948089:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910358656:0@lo:400:kworker.0 00000100:00100000:0.0:1789131305.948130:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910358656:12345-0@lo:400:kworker.0 Request processed in 317us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131305.948137:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789131306.463807:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131306.463885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131306.464815:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358784 00000100:00100000:0.0:1789131306.464825:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358784 00000100:00100000:0.0:1789131306.464890:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789131306.464900:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131306.464938:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131306.465011:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131306.465017:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789131306.465153:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358784:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789131306.587048:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789131307.051530:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:0.0:1789131307.051540:0:7662:0:(genops.c:885:class_export_put()) final put ffff9c0c7aa43800/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:1.0:1789131307.053097:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7aa43800/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-OST0001 00000020:00000080:0.0:1789131307.053695:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7aa40800 for lustre-OST0001 00010000:00010000:2.0:1789131307.611024:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131308.633472:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131308.802707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131308.802750:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131308.802776:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131308.803356:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543808 00000100:00100000:1.0:1789131308.803365:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543808 00000100:00100000:1.0:1789131308.803416:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543680 00000100:00100000:1.0:1789131308.803430:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543680 00000100:00100000:1.0:1789131308.803459:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1789131308.803469:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893543808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131308.803546:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2354:x1876039893543808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131308.803554:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1789131308.803570:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1789131308.803577:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893543680:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131308.803602:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893543680:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131308.803608:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00080000:3.0:1789131308.803671:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131308.807129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543552 00000100:00100000:0.0:1789131308.807144:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543552 00000100:00100000:0.0:1789131308.807208:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:0.0:1789131308.807218:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893543552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131308.807288:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893543552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 71us (4591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131308.807314:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 309 00000100:00100000:3.0:1789131309.530666:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131309.530701:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131309.531625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131309.531723:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910358912 00000100:00100000:3.0:1789131309.531733:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910358912 00000100:00100000:3.0:1789131309.531809:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789131309.531820:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131309.531871:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131309.531926:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910358912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00080000:2.0:1789131309.532786:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789131309.532842:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e903c0 x1876039910358912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131309.532871:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910358912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131309.533199:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1789131309.659986:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131309.724486:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789131310.685814:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131311.065696:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910359296:0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.065791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131311.065872:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131311.065879:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.065908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131311.065949:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359296 00000100:00100000:2.0:1789131311.065958:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359296 00000100:00100000:2.0:1789131311.066041:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789131311.066053:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910359296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.066114:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910359296:12345-0@lo:400:kworker.0 Request processed in 64us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131311.066122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789131311.066155:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359424 00000100:00100000:2.0:1789131311.066159:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359424 00000100:00100000:2.0:1789131311.066188:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789131311.066195:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910359424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.066715:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910359424:12345-0@lo:400:kworker.0 Request processed in 517us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131311.066724:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1789131311.066750:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131311.066756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789131311.066802:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0c7403c3c0 x1876039910359424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789131327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131311.066818:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910359424:0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.066831:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910359296:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.066956:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910359168:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.066999:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131311.067042:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910359680:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.067066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131311.067096:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789131311.067101:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910359040:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.067131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131311.067161:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910359552:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.067184:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131311.067212:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359680 00000100:00100000:3.0:1789131311.067216:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359680 00000100:00100000:3.0:1789131311.067458:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789131311.067467:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910359680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131311.067551:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359040 00000100:00100000:0.0:1789131311.067556:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359040 00000100:00100000:0.0:1789131311.067590:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789131311.067598:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910359040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.067600:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359168 00000100:00100000:2.0:1789131311.067603:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359168 00000100:00100000:2.0:1789131311.067656:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359552 00000100:00100000:2.0:1789131311.067659:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359552 00000100:00100000:2.0:1789131311.067681:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789131311.067686:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910359168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131311.068567:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789131311.068586:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131311.068784:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910359040:12345-0@lo:400:kworker.0 Request processed in 1186us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131311.068794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789131311.069756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910359040:0@lo:400:kworker.0 00000100:00080000:0.0:1789131311.069837:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789131311.069845:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131311.071271:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910359680:12345-0@lo:400:kworker.0 Request processed in 3794us (4193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131311.071289:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789131311.071491:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910359680:0@lo:400:kworker.0 00000100:00100000:2.0:1789131311.071912:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910359168:12345-0@lo:400:kworker.0 Request processed in 4221us (4908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131311.071924:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789131311.072002:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910359168:0@lo:400:kworker.0 00000100:00100000:3.0:1789131311.072301:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910359552:0@lo:400:kworker.0 00000100:00100000:1.0:1789131311.072407:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910359552:12345-0@lo:400:kworker.0 Request processed in 3828us (5219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131311.072417:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000001:02000400:2.0:1789131311.245770:0:12269:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 08:55:10 (1789131310) 00000100:00100000:0.0:1789131311.577760:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131311.577793:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910359808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131311.577891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131311.578085:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359808 00000100:00100000:1.0:1789131311.578096:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359808 00000100:00100000:1.0:1789131311.578161:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789131311.578172:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910359808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131311.578221:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131311.578285:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910359808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131311.578293:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789131311.578549:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910359808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131311.705721:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131312.731414:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131312.948902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131312.949023:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893543936 00000100:00100000:2.0:1789131312.949036:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893543936 00000100:00100000:2.0:1789131312.949135:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1789131312.949149:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:10426:x1876039893543936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131312.949183:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131312.949215:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de3718790472e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039600 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.949545:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.949620:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.949636:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131312.949896:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131312.949908:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131312.950013:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.950046:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de3718790472e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039600 expref: 7 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.950066:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039600 expref: 6 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131312.950077:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b500) 00010000:00010000:2.0:1789131312.950080:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131312.950084:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00080000:0.0:1789131312.950291:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131312.950650:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:10426:x1876039893543936:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1503us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131312.950661:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1789131312.978475:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131312.978755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544064 00000100:00100000:3.0:1789131312.978768:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544064 00000100:00100000:3.0:1789131312.978899:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1789131312.978913:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:10427:x1876039893544064:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131312.978943:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131312.978975:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790473c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039607 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979087:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979105:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979118:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979154:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979162:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.979168:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.986740:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.986769:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.986785:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131312.986988:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1789131312.986993:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131312.987082:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987098:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987105:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987114:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987133:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131312.987139:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987147:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b500) 00010000:00010000:3.0:1789131312.987166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131312.987172:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987178:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987192:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987198:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987203:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987209:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131312.987212:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987218:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987248:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c0c431fa200) 00010000:00010000:3.0:1789131312.987252:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131312.987256:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.987261:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790474a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.990580:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790473c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039607 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.990647:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039607 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131312.990659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c431fac00) 00010000:00010000:3.0:1789131312.990663:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131312.990667:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f000, rc 0) 00000100:00100000:3.0:1789131312.990858:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10427:x1876039893544064:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 11946us (12551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131312.990870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1789131313.012726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131313.012982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544320 00000100:00100000:1.0:1789131313.012995:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544320 00000100:00100000:1.0:1789131313.013148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131313.013163:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10427:x1876039893544320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131313.013189:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131313.013214:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904758 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03960e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.013360:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.013377:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.013390:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.016143:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.016168:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.016180:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018237:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de3718790476d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018256:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de3718790476d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018278:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de3718790476d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131313.018290:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1789131313.018550:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018558:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018565:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018570:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131313.018575:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018582:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018595:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c431fac00) 00010000:00010000:1.0:1789131313.018598:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131313.018602:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018607:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de3718790475f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018621:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018627:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018640:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018645:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131313.018648:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018654:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018662:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0c47f35900) 00010000:00010000:1.0:1789131313.018665:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131313.018668:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.018673:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904766 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.019053:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904758 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03960e expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.019069:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de3718790476d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03960e expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131313.019076:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:1.0:1789131313.019078:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131313.019080:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7c00, rc 0) 00000100:00100000:1.0:1789131313.019152:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10427:x1876039893544320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5992us (6438us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789131313.019170:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131313.032887:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131313.033064:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544448 00000100:00100000:2.0:1789131313.033118:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544448 00000100:00100000:2.0:1789131313.033262:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1789131313.033275:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10427:x1876039893544448:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789131313.033468:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10427:x1876039893544448:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 195us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131313.033477:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00010000:00010000:2.0:1789131313.753554:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131313.819136:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789131313.927491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131313.927549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131313.927577:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131313.927615:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544832 00000100:00100000:0.0:1789131313.927628:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544832 00000100:00100000:0.0:1789131313.927701:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544704 00000100:00100000:0.0:1789131313.927716:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544704 00000100:00100000:0.0:1789131313.927748:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:0.0:1789131313.927760:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893544832:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131313.927859:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893544832:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 102us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131313.927868:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:0.0:1789131313.927888:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1789131313.927895:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2355:x1876039893544704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131313.927925:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2355:x1876039893544704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131313.927932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00080000:0.0:1789131313.927949:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131313.928225:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544576 00000100:00100000:1.0:1789131313.928231:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544576 00000100:00100000:1.0:1789131313.928273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:1.0:1789131313.928282:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893544576:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131313.928317:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893544576:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131313.928348:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 311 00000100:00100000:2.0:1789131314.649672:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131314.649704:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910359936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131314.649799:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131314.650050:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910359936 00000100:00100000:3.0:1789131314.650060:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910359936 00000100:00100000:3.0:1789131314.650144:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789131314.650156:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910359936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131314.650202:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131314.650263:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910359936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131314.650292:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1789131314.650355:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789131314.650584:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b43e903c0 x1876039910359936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131314.650615:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910359936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131314.781018:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131315.080483:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.080811:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893544960 00000100:00100000:1.0:1789131315.080824:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893544960 00000100:00100000:1.0:1789131315.080920:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1789131315.080934:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10470:x1876039893544960:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131315.080964:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131315.080992:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790477b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039615 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081075:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081093:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081108:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081138:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081148:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081155:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081484:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081504:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081512:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081518:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.081524:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081532:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081547:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b500) 00010000:00010000:1.0:1789131315.081550:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.081556:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081562:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904782 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081585:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081591:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081597:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081602:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.081605:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081611:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081619:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131315.081622:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.081625:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081631:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904789 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081671:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790477b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039615 expref: 10 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081682:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b500) 00010000:00010000:1.0:1789131315.081685:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.081696:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de3718790477b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039615 expref: 10 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.081719:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7e00, rc 0) 00000100:00100000:1.0:1789131315.081801:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10470:x1876039893544960:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 870us (1332us total) trans 0 rc 301/301 00000100:00100000:1.0:1789131315.081811:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00080000:3.0:1789131315.082087:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131315.087804:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.087893:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545216 00000100:00100000:3.0:1789131315.087907:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545216 00000100:00100000:3.0:1789131315.087979:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1789131315.087992:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10470:x1876039893545216:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:3.0:1789131315.088075:0:9425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131315.088110:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904735 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039600 expref: 9 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088132:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855b500) 00010000:00010000:3.0:1789131315.088149:0:9425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131315.088561:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088580:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088592:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088607:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088614:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.088621:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131315.094318:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789131315.094381:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094395:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094404:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094412:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131315.094418:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094429:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094450:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131315.094455:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131315.094461:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.094468:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904790 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131315.094504:0:9425:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a1e9b113 reply state 00000000441fae1f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131315.094516:0:9425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131315.094675:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:10470:x1876039893545216:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 6680us (6884us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789131315.094699:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00010000:00010000:3.0:1789131315.100013:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100036:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100044:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100051:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131315.100057:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100066:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100086:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0c431fa100) 00010000:00010000:3.0:1789131315.100090:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131315.100095:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.100101:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904797 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131315.189756:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131315.189803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545344 00000100:00100000:0.0:1789131315.189815:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545344 00000100:00100000:0.0:1789131315.189877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1789131315.189888:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10478:x1876039893545344:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:0.0:1789131315.189918:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131315.189947:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790479e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03961c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190032:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190049:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190093:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131315.190170:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789131315.190174:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131315.190225:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190258:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790479e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03961c expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190279:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03961c expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.190289:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:0.0:1789131315.190292:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131315.190296:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15200, rc 0) 00000100:00100000:0.0:1789131315.190382:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:10478:x1876039893545344:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 496us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131315.190390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1789131315.252644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.252898:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545472 00000100:00100000:2.0:1789131315.252911:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545472 00000100:00100000:2.0:1789131315.252986:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1789131315.252998:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:10484:x1876039893545472:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131315.253031:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131315.253057:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de371879047ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039623 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253143:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253162:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253174:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253191:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253198:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253204:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253400:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253430:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253439:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131315.253478:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1789131315.253482:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131315.253546:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253561:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253568:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253576:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253583:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131315.253588:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253597:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253610:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:2.0:1789131315.253614:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131315.253619:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253637:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879047b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253652:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253659:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253665:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253670:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131315.253673:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253679:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253688:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c0c5855be00) 00010000:00010000:2.0:1789131315.253690:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131315.253694:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253700:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879047ba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253737:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de371879047ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039623 expref: 12 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253751:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039623 expref: 11 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.253765:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131315.253767:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789131315.253769:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebc00, rc 0) 00000100:00100000:2.0:1789131315.253842:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:10484:x1876039893545472:12345-192.168.203.52@tcp:101:bash.0 Request processed in 845us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131315.253851:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1789131315.258871:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.259510:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545728 00000100:00100000:1.0:1789131315.259525:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545728 00000100:00100000:1.0:1789131315.259705:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1789131315.259718:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:10484:x1876039893545728:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131315.259746:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131315.259776:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879047c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03962a expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.259969:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.259987:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.260001:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.263686:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.263708:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.263740:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131315.265815:0:9425:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789131315.266212:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.266228:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.266308:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.266372:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.266381:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.267035:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.267046:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.267052:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.267060:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.267077:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131315.267080:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.267101:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.267108:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879047cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131315.267124:0:9425:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000120a3fb3 reply state 000000006b0d8ed4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131315.267134:0:9425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789131315.269715:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879047c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 14 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.269742:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 13 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.269751:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:2.0:1789131315.269754:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131315.269759:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:2.0:1789131315.269840:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10484:x1876039893545728:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10123us (10983us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789131315.269849:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00010000:00010000:3.0:1789131315.272977:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273002:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273035:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273042:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131315.273048:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273058:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273079:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35d00) 00010000:00010000:3.0:1789131315.273083:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131315.273089:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.273096:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879047d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131315.287460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.287644:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545856 00000100:00100000:2.0:1789131315.287659:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545856 00000100:00100000:2.0:1789131315.287779:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1789131315.287787:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876039893545856:12345-192.168.203.52@tcp:8:bash.0 00010000:00080000:2.0:1789131315.287819:0:6706:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:2.0:1789131315.287850:0:6706:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de371879047eb 00002000:00100000:2.0:1789131315.287863:0:6706:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 17aefd58-d436-480c-8fa4-256f2e59c9d4/ffff9c0c43e91800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789131315.287888:0:6706:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789131315.288170:0:6706:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789131315.288203:0:6706:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e90800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131315.289602:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893545856:12345-192.168.203.52@tcp:8:bash.0 Request processed in 1805us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131315.289614:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1789131315.301929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.302208:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893545984 00000100:00100000:2.0:1789131315.302223:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893545984 00000100:00100000:2.0:1789131315.302378:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00080000:3.0:1789131315.302382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131315.302594:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:0:x1876039893545984:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131315.302613:0:8327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131315.302639:0:8327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039631 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131315.302668:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789131315.302686:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=327s v=(0 0) 00010000:00010000:2.0:1789131315.302691:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131315.302701:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 7 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.302723:0:8327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 7 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.302738:0:8327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceae00, rc 0) 00000100:00100000:2.0:1789131315.302808:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:0:x1876039893545984:12345-192.168.203.52@tcp:101:bash.0 Request processed in 419us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131315.302831:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1789131315.309560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131315.309669:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893546112 00000100:00100000:0.0:1789131315.309684:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893546112 00000100:00100000:0.0:1789131315.309758:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1789131315.309769:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10484:x1876039893546112:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131315.309802:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131315.309824:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039638 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.309854:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.309863:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131315.309868:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131315.309874:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.309906:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.309920:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131315.309935:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d892c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1876039910360064:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131315.310250:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131315.319669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.319780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893546240 00000100:00100000:1.0:1789131315.319800:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893546240 00000100:00100000:2.0:1789131315.319821:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d892c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6705:1876039910360064:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131315.319863:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 9 pid: 8327 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.319865:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 9 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.319915:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14600, rc 0) 00000100:00100000:1.0:1789131315.319949:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1789131315.319962:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893546240:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131315.319981:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789131315.320084:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:10484:x1876039893546112:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10313us (10536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131315.320097:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:1.0:1789131315.320259:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.320279:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.320443:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879047f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039631 expref: 8 pid: 8327 timeout: 427 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.320463:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131315.320497:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131315.320510:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.320523:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.320685:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131315.320704:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910360192:192.168.203.52@tcp:105: 00000100:00100000:1.0:1789131315.320806:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74781780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131315.323984:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff070c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910360192:192.168.203.52@tcp:105: 00010000:00010000:1.0:1789131315.324092:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131315.324236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893546240:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4274us (4576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.324250:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:0.0:1789131315.325849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.329022:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893546496 00000100:00100000:3.0:1789131315.329043:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893546496 00000100:00100000:3.0:1789131315.329141:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1789131315.329155:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10484:x1876039893546496:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1789131315.330899:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10484:x1876039893546496:12345-192.168.203.52@tcp:35:bash.0 Request processed in 1733us (5048us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789131315.330915:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1789131315.414034:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.414190:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893546752 00000100:00100000:2.0:1789131315.414205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893546752 00000100:00100000:2.0:1789131315.414290:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1789131315.414302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10494:x1876039893546752:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131315.414797:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131315.414829:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904800 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03963f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131315.415005:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789131315.415176:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904800 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03963f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.415196:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:2.0:1789131315.415199:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131315.415205:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904800 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03963f expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.415247:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131315.416852:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10494:x1876039893546752:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2536us (2819us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789131315.416867:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1789131315.425894:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.426341:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547008 00000100:00100000:2.0:1789131315.426354:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547008 00000100:00100000:2.0:1789131315.426432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1789131315.426444:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10494:x1876039893547008:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1789131315.427141:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10494:x1876039893547008:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 695us (1261us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789131315.427151:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131315.515100:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.515642:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547136 00000100:00100000:1.0:1789131315.515653:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547136 00000100:00100000:1.0:1789131315.515735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1789131315.515746:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10500:x1876039893547136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131315.515776:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131315.515803:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790480e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039646 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.515883:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.515916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.515930:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131315.516009:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1789131315.516013:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131315.516046:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.516083:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790480e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039646 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.516110:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039646 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.516120:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131315.516123:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131315.516127:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7e00, rc 0) 00000100:00100000:1.0:1789131315.516215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10500:x1876039893547136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 470us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.516223:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1789131315.522666:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.522946:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547392 00000100:00100000:2.0:1789131315.522962:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547392 00000100:00100000:2.0:1789131315.523049:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1789131315.523062:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10500:x1876039893547392:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131315.523092:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131315.523126:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790481c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03964d expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.523269:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de37187904823 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.523285:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de37187904823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.523296:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de37187904823 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131315.523317:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789131315.524207:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790481c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03964d expref: 20 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.524244:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de37187904823 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03964d expref: 19 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.524258:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:2.0:1789131315.524262:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131315.524266:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceac00, rc 0) 00000100:00100000:2.0:1789131315.525812:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10500:x1876039893547392:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2744us (3156us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789131315.525830:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1789131315.531226:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.531271:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.531374:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547520 00000100:00100000:1.0:1789131315.531387:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547520 00000100:00100000:1.0:1789131315.531478:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1789131315.531499:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:2352:x1876039893547520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131315.531519:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131315.531571:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de37187904823 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03964d expref: 19 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.531598:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:1.0:1789131315.531604:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131315.531681:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:2352:x1876039893547520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 194us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.531691:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1789131315.531918:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547776 00000100:00100000:0.0:1789131315.531924:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547776 00000100:00100000:0.0:1789131315.531959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1789131315.531967:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10500:x1876039893547776:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131315.531994:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131315.532014:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904831 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039654 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.532129:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.532147:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.532160:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131315.532174:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789131315.532374:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904831 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039654 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.532392:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039654 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.532400:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:0.0:1789131315.532403:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131315.532406:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15400, rc 0) 00000100:00100000:0.0:1789131315.532449:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10500:x1876039893547776:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 482us (1236us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789131315.532468:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1789131315.542622:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131315.544872:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893547904 00000100:00100000:0.0:1789131315.544892:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893547904 00000100:00100000:0.0:1789131315.545038:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1789131315.545051:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893547904:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:0.0:1789131315.545113:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.545137:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.545147:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131315.545151:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131315.545156:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.545202:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.545218:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131315.545236:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c4634cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1876039910360320:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131315.545402:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15540 going to sleep for 11 seconds 00000100:00100000:3.0:1789131315.550018:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c4634cb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1876039910360320:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131315.550056:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131315.558256:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131315.561521:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548032 00000100:00100000:0.0:1789131315.561545:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548032 00002000:00100000:0.0:1789131315.561599:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c0c742cd2c0 x1876039893548032/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:276/0 lens 504/0 e 0 to 0 dl 1789131326 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789131315.561609:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742cd2c0 with x1876039893548032 ext(0->12) 00010000:00010000:0.0:1789131315.561617:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 8 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131315.561633:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 8 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131315.561641:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742cd2c0 00000100:00100000:0.0:1789131315.561730:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1789131315.561740:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893548032:12345-192.168.203.52@tcp:4:lfs.0 00000001:00100000:1.0:1789131315.633510:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000001:00080000:3.0:1789131315.688137:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:1.0:1789131315.688345:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893548032:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 126602us (130092us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789131315.688364:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:1.0:1789131315.688376:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c0c742cd2c0 x1876039893548032/t4294967299(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:276/0 lens 504/448 e 0 to 0 dl 1789131326 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131315.688388:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742cd2c0 with x1876039893548032 ext(0->12) 00010000:00010000:1.0:1789131315.688518:0:6710:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.688539:0:6710:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131315.688548:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742cd2c0 00000100:00100000:0.0:1789131315.693648:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.694027:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548160 00000100:00100000:1.0:1789131315.694037:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548160 00010000:00010000:1.0:1789131315.694150:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131315.694214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1789131315.694224:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893548160:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131315.694239:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789131315.694257:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789131315.694261:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789131315 00002000:00010000:1.0:1789131315.694263:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789131316 00002000:00010000:1.0:1789131315.694265:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789131315 00002000:00010000:1.0:1789131315.694267:0:5832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1789131315.694273:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.694298:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.694365:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000323898a7/0x9f0de371879047f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039638 expref: 7 pid: 6705 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.694384:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131315.694388:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131315.694394:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.694513:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.694559:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131315.694608:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893548160:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 385us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.694615:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00010000:00010000:3.0:1789131315.694754:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694764:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694788:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694796:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694804:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694810:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131315.694814:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694822:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694835:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.694854:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097203d1d/0x9f0de37187904846 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131315.694987:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893547904:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 149938us (152380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131315.694997:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1789131315.703146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.703242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548416 00000100:00100000:2.0:1789131315.703252:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548416 00000100:00100000:2.0:1789131315.703632:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1789131315.703646:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10500:x1876039893548416:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:2.0:1789131315.703714:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039654 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131315.704016:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1789131315.704075:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1789131315.705107:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789131315.705170:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.705187:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 24 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.705197:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.705641:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 24 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.705659:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 24 pid: 9425 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131315.705673:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910360448:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131315.705810:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789131315.718304:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.718656:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548544 00000100:00100000:1.0:1789131315.718665:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548544 00010000:00010000:1.0:1789131315.718705:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 25 pid: 9425 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131315.718747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1789131315.718757:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:2352:x1876039893548544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131315.718772:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131315.718779:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 25 pid: 9425 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.718791:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 25 pid: 9425 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.718814:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:1.0:1789131315.718819:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.718829:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.718836:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.718872:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131315.718940:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:2352:x1876039893548544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 185us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.718948:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00010000:00010000:2.0:1789131315.724536:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879047dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03962a expref: 24 pid: 9425 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131315.724568:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910360448:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131315.724590:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.724600:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.724604:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131315.724743:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789131315.728165:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789131315.729540:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910360576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131315.729632:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131315.729737:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131315.732913:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910360576 00000100:00100000:1.0:1789131315.732926:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910360576 00000100:00100000:1.0:1789131315.732985:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131315.733060:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876039910360576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131315.733593:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910360576:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131315.734250:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789131315.734394:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910360704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131315.734607:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131315.734741:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131315.734949:0:5850:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1789131315.734957:0:5850:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1789131315.735214:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910360704 00000100:00100000:2.0:1789131315.735221:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910360704 00000100:00100000:3.0:1789131315.735593:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131315.735603:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5847:x1876039910360704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131315.735877:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5847:x1876039910360704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 275us (1270us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789131315.735885:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131315.736033:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910360704:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131315.736099:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1789131315.736144:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736155:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736163:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736170:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131315.736175:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736184:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736208:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:2.0:1789131315.736212:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789131315.736218:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.736225:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790484d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131315.736775:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:1.0:1789131315.736869:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1876039910360576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 216us (3577us total) trans 0 rc 0/0 00000040:00080000:2.0:1789131315.737147:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789131315.737158:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 327710835997ns, next at 328710833868ns, rc = 0 00000001:00080000:2.0:1789131315.737167:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789131315.737203:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35c00) 00010000:00010000:2.0:1789131315.737206:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789131315.737213:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904838 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039654 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131315.737367:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10500:x1876039893548416:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 33724us (34230us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789131315.737376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000020:00080000:2.0:1789131315.737379:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789131315.740005:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131315.745020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.745961:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548672 00000100:00100000:3.0:1789131315.745971:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548672 00000100:00100000:3.0:1789131315.746033:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1789131315.746043:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10500:x1876039893548672:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131315.746067:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131315.746089:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904854 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03965b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.746145:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904854 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03965b expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.746159:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904854 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03965b expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.746192:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131315.746195:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131315.746198:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ec00, rc 0) 00000100:00100000:3.0:1789131315.746516:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:10500:x1876039893548672:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 473us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131315.746524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1789131315.752148:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.752276:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893548928 00000100:00100000:3.0:1789131315.752294:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893548928 00000100:00100000:3.0:1789131315.752392:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1789131315.752598:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:10500:x1876039893548928:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131315.752834:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10500:x1876039893548928:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 432us (693us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789131315.752841:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:1.0:1789131315.802002:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131315.848389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.848462:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893549184 00000100:00100000:2.0:1789131315.848472:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893549184 00000100:00100000:2.0:1789131315.848542:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1789131315.848551:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10510:x1876039893549184:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131315.848572:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131315.848600:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790485b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039662 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131315.848722:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1789131315.848837:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790485b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039662 expref: 31 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.848851:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:2.0:1789131315.848855:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131315.848860:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de3718790485b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039662 expref: 31 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.848873:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebe00, rc 0) 00000100:00100000:2.0:1789131315.848934:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10510:x1876039893549184:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 384us (553us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1789131315.848942:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1789131315.854918:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131315.855546:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893549312 00000100:00100000:1.0:1789131315.855555:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893549312 00000100:00100000:1.0:1789131315.855615:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1789131315.855625:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10510:x1876039893549312:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1789131315.855703:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855721:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855733:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855749:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855774:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855781:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855878:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855888:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855900:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131315.855941:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855954:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855961:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855968:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855978:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.855982:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.855990:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856010:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131315.856013:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.856018:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856025:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904869 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856037:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856043:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856049:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856054:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.856057:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856063:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856071:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35b00) 00010000:00010000:1.0:1789131315.856074:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.856076:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856082:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856118:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856124:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856129:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856134:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131315.856137:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856143:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856151:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131315.856153:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131315.856156:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131315.856162:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904877 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131315.856283:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10510:x1876039893549312:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 657us (1371us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131315.856291:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1789131315.860491:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.860745:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893549568 00000100:00100000:2.0:1789131315.860755:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893549568 00000100:00100000:2.0:1789131315.860951:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131315.860962:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10510:x1876039893549568:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1789131315.861198:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:10510:x1876039893549568:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 237us (723us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1789131315.861206:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1789131315.917385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.920876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893549824 00000100:00100000:3.0:1789131315.920968:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893549824 00000100:00100000:3.0:1789131315.921172:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1789131315.921185:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:10513:x1876039893549824:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131315.921209:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131315.921231:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790487e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039669 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921305:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921319:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921364:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921379:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921387:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921393:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921778:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921788:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.921795:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131315.921805:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789131315.922267:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922277:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922284:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922290:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131315.922302:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922311:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922348:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131315.922352:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131315.922356:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922363:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904885 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922376:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922382:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922388:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922394:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131315.922397:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922402:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922410:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c431fa100) 00010000:00010000:3.0:1789131315.922412:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131315.922422:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922428:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790488c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922681:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790487e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922702:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131315.922710:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131315.922712:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131315.922714:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e800, rc 0) 00000100:00100000:3.0:1789131315.922845:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10513:x1876039893549824:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1662us (5468us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789131315.922854:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131315.925904:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131315.926035:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893549952 00000100:00100000:2.0:1789131315.926044:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893549952 00000100:00100000:2.0:1789131315.926153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1789131315.926164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10513:x1876039893549952:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1789131315.926231:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926263:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926275:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926300:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926319:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926367:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926374:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131315.926378:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926385:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926397:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:2.0:1789131315.926399:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131315.926404:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131315.926411:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131315.926473:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10513:x1876039893549952:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 310us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131315.926499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1789131315.928844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131315.928920:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893550208 00000100:00100000:3.0:1789131315.928930:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893550208 00000100:00100000:3.0:1789131315.928983:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1789131315.928993:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10513:x1876039893550208:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131315.929244:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:10513:x1876039893550208:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 252us (408us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789131315.929252:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1789131316.185989:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910361088:0@lo:400:kworker.0 00000100:00100000:2.0:1789131316.186057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131316.186115:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131316.186121:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910361216:0@lo:400:kworker.0 00000100:00100000:2.0:1789131316.186149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131316.186183:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910361216 00000100:00100000:2.0:1789131316.186189:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910361216 00000100:00100000:2.0:1789131316.186239:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789131316.186248:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910361216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131316.186296:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa183c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910361216:12345-0@lo:400:kworker.0 Request processed in 49us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131316.186303:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789131316.186366:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910361216:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186508:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910360832:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186544:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131316.186592:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910361344:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186615:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131316.186635:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789131316.186640:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910360960:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186660:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131316.186677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910361472:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186711:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131316.186737:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910361472 00000100:00100000:1.0:1789131316.186741:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910361472 00000100:00100000:1.0:1789131316.186766:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789131316.186773:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910361472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186821:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910361472:12345-0@lo:400:kworker.0 Request processed in 48us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.186828:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789131316.186857:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910361472:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186873:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910361088 00000100:00100000:1.0:1789131316.186876:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910361088 00000100:00100000:1.0:1789131316.186900:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910361344 00000100:00100000:1.0:1789131316.186903:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910361344 00000100:00100000:1.0:1789131316.186919:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910360960 00000100:00100000:1.0:1789131316.186921:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910360960 00000100:00100000:1.0:1789131316.186933:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789131316.186939:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910361088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.186971:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910361088:12345-0@lo:400:kworker.0 Request processed in 32us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.186978:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789131316.186989:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789131316.187000:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910361344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.187030:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910361344:12345-0@lo:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.187037:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789131316.187048:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789131316.187054:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910360960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.187076:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910360960:12345-0@lo:400:kworker.0 Request processed in 23us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.187081:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789131316.187104:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910361088:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.187125:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910360960:0@lo:400:kworker.0 00000100:00100000:1.0:1789131316.187134:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910361344:0@lo:400:kworker.0 00000100:00100000:2.0:1789131316.187475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910360832 00000100:00100000:2.0:1789131316.187491:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910360832 00000100:00100000:2.0:1789131316.187528:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789131316.187535:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910360832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131316.187571:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910360832:12345-0@lo:400:kworker.0 Request processed in 37us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131316.187578:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00080000:3.0:1789131316.188289:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131316.188296:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131316.188299:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131316.189791:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910360832:0@lo:400:kworker.0 00000100:00100000:0.0:1789131316.226603:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.226753:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893550464 00000100:00100000:1.0:1789131316.226764:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893550464 00000100:00100000:1.0:1789131316.226859:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1789131316.226870:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:10544:x1876039893550464:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1789131316.226895:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131316.226916:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879048a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039670 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.227010:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.227025:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.227051:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131316.227064:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789131316.227202:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de371879048a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039670 expref: 37 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.227224:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039670 expref: 36 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.227233:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131316.227236:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131316.227240:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:1.0:1789131316.227313:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:10544:x1876039893550464:12345-192.168.203.52@tcp:101:cat.0 Request processed in 444us (719us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789131316.227360:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1789131316.231287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131316.231471:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893550720 00000100:00100000:3.0:1789131316.231504:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893550720 00000100:00100000:3.0:1789131316.231561:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1789131316.231571:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:10544:x1876039893550720:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:3.0:1789131316.231865:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:10544:x1876039893550720:12345-192.168.203.52@tcp:35:cat.0 Request processed in 295us (591us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789131316.231874:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1789131316.232418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.232668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893550848 00000100:00100000:1.0:1789131316.232675:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893550848 00000100:00100000:1.0:1789131316.232728:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1789131316.232737:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:2354:x1876039893550848:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131316.232749:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131316.232782:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039670 expref: 37 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.232799:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131316.232805:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131316.232855:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:2354:x1876039893550848:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 119us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.232863:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1789131316.290763:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.290971:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893551104 00000100:00100000:1.0:1789131316.290986:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893551104 00000100:00100000:1.0:1789131316.291070:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1789131316.291083:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:10550:x1876039893551104:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1789131316.291115:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131316.291119:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789131316.291155:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039646 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.291179:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131316.291186:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131316.291203:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048bd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039677 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131316.292198:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131316.292246:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131316.292256:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131316.292340:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131316.292358:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 36 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131316.292376:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c4634fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910361600:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131316.292511:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131316.298099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131316.298224:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893551232 00000100:00100000:2.0:1789131316.298237:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893551232 00010000:00010000:2.0:1789131316.298293:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 37 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131316.298404:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1789131316.298416:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:2353:x1876039893551232:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131316.298449:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131316.298458:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 37 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.298474:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 37 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.298515:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:2.0:1789131316.298522:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.298534:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.298543:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.298571:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131316.298642:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:2353:x1876039893551232:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 228us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131316.298651:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00010000:00010000:1.0:1789131316.300118:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904893 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039669 expref: 36 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131316.300149:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c4634fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910361600:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131316.300186:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.300199:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.300207:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131316.300463:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789131316.300721:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de371879048bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 37 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.300743:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 36 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.300753:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131316.300756:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131316.300760:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:1.0:1789131316.300843:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:10550:x1876039893551104:12345-192.168.203.52@tcp:101:dd.0 Request processed in 9763us (10095us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789131316.300853:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1789131316.306494:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.306840:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893551488 00000100:00100000:1.0:1789131316.306857:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893551488 00000100:00100000:1.0:1789131316.306952:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1789131316.306964:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:10550:x1876039893551488:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:1.0:1789131316.307392:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.307638:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.307658:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131316.307733:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789131316.307787:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000900234a5 reply state 0000000093a7f04f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131316.307797:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131316.307966:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:10550:x1876039893551488:12345-192.168.203.52@tcp:36:dd.0 Request processed in 1000us (1500us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789131316.307976:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000020:00080000:1.0:1789131316.307983:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131316.312159:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312184:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312191:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312199:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131316.312204:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312212:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312232:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131316.312236:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131316.312241:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.312247:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de371879048d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131316.592178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131316.592415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893551616 00000100:00100000:2.0:1789131316.592425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893551616 00000100:00100000:2.0:1789131316.592494:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1789131316.592505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:10564:x1876039893551616:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:2.0:1789131316.592542:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131316.592563:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879048d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03967e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592641:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592656:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592667:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592683:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592690:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592697:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592802:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592813:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 39 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.592820:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.594381:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 39 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.594414:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 39 pid: 8131 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131316.594430:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910361728:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131316.595457:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131316.600741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131316.600825:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893551872 00000100:00100000:3.0:1789131316.600834:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893551872 00000100:00100000:3.0:1789131316.600893:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1789131316.600904:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:5589:x1876039893551872:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789131316.601246:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:5589:x1876039893551872:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 343us (515us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1789131316.601253:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1789131316.602494:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910361728:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131316.602524:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131316.605505:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131316.605616:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893552000 00000100:00100000:2.0:1789131316.605625:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893552000 00010000:00010000:2.0:1789131316.605667:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 41 pid: 8131 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131316.605709:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1789131316.605719:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:2352:x1876039893552000:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131316.605734:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131316.605741:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 41 pid: 8131 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.605752:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 41 pid: 8131 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.605774:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879048c4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039677 expref: 41 pid: 8131 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.605808:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:2.0:1789131316.605813:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.605822:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.605830:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131316.606251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131316.606314:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:2352:x1876039893552000:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 596us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131316.606367:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00010000:00010000:3.0:1789131316.606817:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.606827:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131316.607012:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789131316.607017:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131316.607059:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607072:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607081:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607086:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607092:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607248:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131316.607253:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607260:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607273:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131316.607276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131316.607280:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607286:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de371879048e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607299:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607306:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607311:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607316:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131316.607318:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607368:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c5855bd00) 00010000:00010000:3.0:1789131316.607390:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131316.607571:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607580:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de371879048e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607621:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de371879048d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03967e expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607636:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03967e expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.607642:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131316.607644:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131316.607646:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceac00, rc 0) 00000100:00100000:3.0:1789131316.607700:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:10564:x1876039893551616:12345-192.168.203.52@tcp:101:stat.0 Request processed in 15197us (15532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131316.607708:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1789131316.672207:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.673224:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893552256 00000100:00100000:1.0:1789131316.673245:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893552256 00000100:00100000:1.0:1789131316.673354:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:1.0:1789131316.673365:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:10570:x1876039893552256:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:1.0:1789131316.673419:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131316.673448:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceac00/0x9f0de371879048ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03967e expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.673469:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131316.673474:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131316.673695:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.673709:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.673720:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131316.673774:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1789131316.673798:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008b6fdd76 reply state 000000004d1a8bee transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131316.673822:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131316.673945:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:10570:x1876039893552256:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 581us (1745us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789131316.673953:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000020:00080000:1.0:1789131316.673958:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131316.681438:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681456:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681464:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681498:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131316.681503:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681512:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681529:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131316.681533:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131316.681538:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.681543:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131316.697708:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131316.697731:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910361856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131316.697802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131316.697901:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910361856 00000100:00100000:1.0:1789131316.697909:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910361856 00000100:00100000:1.0:1789131316.697963:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789131316.697973:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910361856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131316.698011:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131316.698078:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910361856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.698085:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789131316.698367:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff07840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910361856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131316.826157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131316.888609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131316.888791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893552384 00000100:00100000:1.0:1789131316.888801:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893552384 00000100:00100000:1.0:1789131316.888863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1789131316.888873:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:10583:x1876039893552384:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:1.0:1789131316.888895:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131316.888915:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039685 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.888977:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.888991:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889020:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889034:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889042:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889048:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889165:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889174:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889182:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131316.889215:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1789131316.889219:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131316.889240:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889251:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889259:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889275:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889281:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889287:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131316.889291:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889297:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889309:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131316.889312:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131316.889316:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904903 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889379:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889385:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889391:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889396:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131316.889405:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889412:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889420:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35600) 00010000:00010000:1.0:1789131316.889423:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131316.889426:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889432:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790490a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889466:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de371879048fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889488:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131316.889496:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131316.889498:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131316.889501:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7e00, rc 0) 00000100:00100000:1.0:1789131316.889563:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:10583:x1876039893552384:12345-192.168.203.52@tcp:101:stat.0 Request processed in 691us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131316.889570:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1789131316.997555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131316.997656:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893552640 00000100:00100000:3.0:1789131316.997666:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893552640 00000100:00100000:3.0:1789131316.997723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1789131316.997733:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:10594:x1876039893552640:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131316.997754:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131316.997775:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03968c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131316.997881:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1789131316.998000:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904918 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03968c expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.998014:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:3.0:1789131316.998030:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131316.998036:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03968c expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131316.998050:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e200, rc 0) 00000100:00100000:3.0:1789131316.998113:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+42:10594:x1876039893552640:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 381us (569us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789131316.998122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1789131317.010166:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.010246:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893552896 00000100:00100000:3.0:1789131317.010256:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893552896 00000100:00080000:0.0:1789131317.010416:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131317.010516:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1789131317.010529:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+42:10594:x1876039893552896:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131317.010789:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:10594:x1876039893552896:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 262us (630us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789131317.010797:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1789131317.091634:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.091743:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893553152 00000100:00100000:1.0:1789131317.091752:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893553152 00000100:00100000:1.0:1789131317.091820:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1789131317.091831:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:10600:x1876039893553152:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131317.091853:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131317.091875:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904926 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039693 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.091970:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.091985:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.091993:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.092025:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.092044:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 44 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131317.092057:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff06940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910361984:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131317.092154:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45663b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131317.095741:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff06940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910361984:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131317.095778:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131317.096425:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131317.096625:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893553280 00000100:00100000:2.0:1789131317.096640:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893553280 00010000:00010000:2.0:1789131317.096687:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131317.096739:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1789131317.096749:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:2353:x1876039893553280:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131317.096762:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131317.096770:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096783:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096835:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904911 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039685 expref: 45 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096854:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:2.0:1789131317.096859:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096868:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096875:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.096905:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131317.096950:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131317.096967:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:2353:x1876039893553280:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 218us (545us total) trans 0 rc 0/0 00010000:00010000:1.0:1789131317.096972:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131317.096982:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000004:00200000:1.0:1789131317.097010:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789131317.098530:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904926 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 45 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.098559:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 44 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.098569:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131317.098572:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131317.098576:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:1.0:1789131317.098646:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:10600:x1876039893553152:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6818us (7022us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789131317.098656:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1789131317.102741:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.102830:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893553536 00000100:00100000:1.0:1789131317.102843:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893553536 00000100:00100000:1.0:1789131317.102909:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1789131317.102921:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:10600:x1876039893553536:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1789131317.103287:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.103309:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.103354:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131317.103411:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789131317.103436:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b96d1169 reply state 00000000e594308e transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131317.103445:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131317.103560:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10600:x1876039893553536:12345-192.168.203.52@tcp:36:bash.0 Request processed in 641us (834us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789131317.103569:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000020:00080000:1.0:1789131317.103575:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131317.105702:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105723:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105731:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105739:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.105745:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105754:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105775:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.105778:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.105784:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.105791:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de3718790493b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131317.112624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131317.112697:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893553664 00000100:00100000:2.0:1789131317.112712:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893553664 00000100:00100000:2.0:1789131317.112773:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1789131317.112783:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:10600:x1876039893553664:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131317.112876:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131317.112899:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904942 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03969a expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.112983:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.113014:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 47 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.113023:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.113056:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 47 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.113070:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 47 pid: 8131 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131317.113084:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910362112:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131317.113232:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131317.115874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.115966:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893553792 00000100:00100000:1.0:1789131317.115981:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893553792 00010000:00010000:1.0:1789131317.116039:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 48 pid: 8131 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131317.116103:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1789131317.116125:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:2353:x1876039893553792:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131317.116290:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131317.116300:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 48 pid: 8131 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.116382:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 48 pid: 8131 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.116421:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131317.116427:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.116437:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.116446:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.116471:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131317.116898:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:2353:x1876039893553792:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 773us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131317.116909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:2.0:1789131317.121420:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de3718790492d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039693 expref: 47 pid: 8131 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131317.121449:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa18000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910362112:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131317.121486:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.121497:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.121503:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131317.121550:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789131317.121571:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131317.121593:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.121626:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904942 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03969a expref: 47 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.121640:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03969a expref: 46 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.121649:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:2.0:1789131317.121652:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131317.121656:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceba00, rc 0) 00000100:00100000:2.0:1789131317.121768:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:10600:x1876039893553664:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8986us (9157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131317.121778:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1789131317.125298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.127904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893554048 00000100:00100000:1.0:1789131317.127921:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893554048 00000100:00100000:1.0:1789131317.128006:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1789131317.128016:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:10600:x1876039893554048:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1789131317.128270:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493da050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10600:x1876039893554048:12345-192.168.203.52@tcp:35:bash.0 Request processed in 254us (2986us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789131317.128278:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1789131317.210914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.211035:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893554304 00000100:00100000:1.0:1789131317.211050:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893554304 00000100:00100000:1.0:1789131317.211879:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1789131317.212464:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10610:x1876039893554304:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131317.212935:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131317.212967:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396a1 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131317.213117:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1789131317.213802:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904950 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396a1 expref: 49 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.213819:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:0.0:1789131317.213822:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131317.213828:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396a1 expref: 49 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.213849:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131317.213937:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:10610:x1876039893554304:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2021us (3042us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789131317.213947:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1789131317.218569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.222862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893554432 00000100:00100000:3.0:1789131317.222883:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893554432 00000100:00100000:1.0:1789131317.234014:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1789131317.234034:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:10610:x1876039893554432:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1789131317.234143:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234166:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234181:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234200:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234208:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234216:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234735:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234745:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131317.234803:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234817:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234831:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234839:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234845:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131317.234851:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234859:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234873:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131317.234877:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131317.234883:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234889:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de3718790495e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234910:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234916:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234923:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234929:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131317.234938:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234945:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234953:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35600) 00010000:00010000:1.0:1789131317.234956:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131317.234959:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904965 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234983:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234989:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.234996:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.235001:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131317.235004:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.235010:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.235019:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131317.235021:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131317.235032:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.235038:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de3718790496c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131317.235287:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:10610:x1876039893554432:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1253us (16722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131317.235298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1789131317.241589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.241639:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893554688 00000100:00100000:1.0:1789131317.241652:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893554688 00000100:00100000:1.0:1789131317.241728:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1789131317.241741:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:10610:x1876039893554688:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131317.242691:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10610:x1876039893554688:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 944us (1108us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789131317.242704:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131317.297515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.297588:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893554944 00000100:00100000:3.0:1789131317.297601:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893554944 00000100:00100000:3.0:1789131317.297671:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1789131317.297684:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10613:x1876039893554944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131317.297719:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131317.297747:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904973 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396a8 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298037:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298057:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298072:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298090:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298098:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.298106:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299292:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904988 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299316:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299360:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904988 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131317.299374:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789131317.299500:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299509:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299517:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299524:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.299528:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299546:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299561:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131317.299565:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.299569:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299576:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790497a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299589:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299600:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299607:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299612:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.299615:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299621:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299628:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c431fa100) 00010000:00010000:3.0:1789131317.299631:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.299634:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299640:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904981 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299699:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904973 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396a8 expref: 52 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299713:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904988 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396a8 expref: 51 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.299721:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.299723:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131317.299731:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f200, rc 0) 00000100:00100000:3.0:1789131317.299829:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:10613:x1876039893554944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2147us (2330us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789131317.299840:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1789131317.303164:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131317.303213:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.303819:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893555072 00000100:00100000:1.0:1789131317.303833:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893555072 00000100:00100000:1.0:1789131317.303911:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1789131317.303924:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:10613:x1876039893555072:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1789131317.304014:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304036:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304051:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131317.304102:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893555200 00010000:00010000:1.0:1789131317.304108:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131317.304109:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893555200 00010000:00010000:1.0:1789131317.304120:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304128:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304145:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131317.304151:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304160:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131317.304161:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1789131317.304170:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:2355:x1876039893555200:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131317.304187:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131317.304828:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:1.0:1789131317.304834:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131317.304841:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.304849:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904996 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.304855:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904988 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396a8 expref: 52 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.304874:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.304878:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131317.304966:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:10613:x1876039893555072:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 1043us (1815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131317.304976:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1789131317.305061:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:2355:x1876039893555200:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 793us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131317.305072:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1789131317.310243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.310539:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893555456 00000100:00100000:3.0:1789131317.310553:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893555456 00000100:00100000:3.0:1789131317.310624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1789131317.310638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:10613:x1876039893555456:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131317.311188:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:10613:x1876039893555456:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 549us (967us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1789131317.311199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000001:00080000:0.0:1789131317.319228:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000001:00080000:0.0:1789131317.319254:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:0.0:1789131317.319315:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789131317.319388:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c742c70c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789131317.319395:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c74451800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c742c73c0 00000020:00080000:0.0:1789131317.319398:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c74451300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c742fd800 00000100:00100000:0.0:1789131317.319999:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910362240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131317.320093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1789131317.320204:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789131317.320386:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789131317.320411:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910362240 00000100:00100000:2.0:1789131317.320421:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910362240 00000100:00100000:2.0:1789131317.320492:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131317.320503:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910362240:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789131317.320904:0:6706:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789131317.320951:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3fa33, atime: 0x6aa3fa34, ctime: 0x6aa3fa33, blocks: 0xb 00010000:00010000:2.0:1789131317.320969:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.321000:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:2.0:1789131317.321005:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131317.321013:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.321032:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.321043:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.321053:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.321076:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131317.322572:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131317.322584:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.322612:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131317.322617:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.322630:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.322654:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.322661:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de3718790499d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.322699:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131317.322700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131317.322702:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131317.326365:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910362240:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5844us (6252us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789131317.326390:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1789131317.328013:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c7ff04780/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789131317.328031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910362240:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131317.453233:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.453468:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893555712 00000100:00100000:3.0:1789131317.453492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893555712 00000100:00100000:3.0:1789131317.453574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1789131317.453604:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10631:x1876039893555712:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1789131317.453636:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131317.453666:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396af expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.453917:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.453937:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.456234:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131317.456264:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789131317.456713:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.456741:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396af expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.456754:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.456757:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789131317.456762:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e200, rc 0) 00000100:00100000:3.0:1789131317.456871:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10631:x1876039893555712:12345-192.168.203.52@tcp:101:cat.0 Request processed in 3268us (3651us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789131317.456882:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1789131317.486986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.487788:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893555840 00000100:00100000:3.0:1789131317.487804:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893555840 00000100:00100000:2.0:1789131317.488139:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1789131317.488151:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10632:x1876039893555840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131317.488185:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131317.488213:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de371879049b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396b6 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.488299:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.488576:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.488593:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131317.489828:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1789131317.489838:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131317.490051:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.490097:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de371879049b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396b6 expref: 19 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.490118:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396b6 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131317.490128:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131317.490131:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131317.490135:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131317.490233:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10632:x1876039893555840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2084us (3262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131317.490244:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1789131317.498968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.499060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556224 00000100:00100000:3.0:1789131317.499074:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556224 00000100:00100000:3.0:1789131317.499159:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1789131317.499171:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10632:x1876039893556224:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131317.499912:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10632:x1876039893556224:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 738us (958us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1789131317.499924:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1789131317.504966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.505092:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556352 00000100:00100000:3.0:1789131317.505105:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556352 00000100:00100000:3.0:1789131317.505488:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1789131317.505501:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10632:x1876039893556352:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1789131317.505522:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789131317.505814:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904949 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03969a expref: 19 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.505842:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396af expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.505856:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904854 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03965b expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.505866:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.505880:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131317.507765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10632:x1876039893556352:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 2251us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131317.507782:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131317.510770:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131317.510940:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556480 00000100:00100000:1.0:1789131317.510952:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556480 00000100:00100000:1.0:1789131317.511025:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1789131317.511036:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10632:x1876039893556480:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1789131317.511196:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.511240:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131317.511255:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131317.512090:0:8131:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131317.512383:0:8131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789131317.512457:0:8131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789131317.512606:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10632:x1876039893556480:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 1566us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131317.512618:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1789131317.535621:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.535836:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556608 00000100:00100000:3.0:1789131317.535850:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556608 00000100:00100000:3.0:1789131317.535965:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1789131317.535978:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10634:x1876039893556608:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131317.536029:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131317.536059:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879049ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536145:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536164:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536177:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536194:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536201:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536208:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536640:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536651:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536659:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131317.536705:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789131317.536717:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131317.536750:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536775:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536781:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536788:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536795:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.536800:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536809:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536823:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131317.536827:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.536832:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de371879049d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536853:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536868:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536874:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536879:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.536882:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536889:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536897:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.536899:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.536902:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536908:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de371879049dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536950:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879049ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536966:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.536973:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:3.0:1789131317.536975:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131317.536984:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f400, rc 0) 00000100:00100000:3.0:1789131317.537077:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10634:x1876039893556608:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1102us (1473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131317.537086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00010000:00010000:3.0:1789131317.849678:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131317.913800:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131317.913814:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131317.913894:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789131317.913903:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131317.914090:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aab7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910362368:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131317.914226:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131317.922998:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aab7840 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910362368:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789131317.926759:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.927863:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556736 00000100:00100000:3.0:1789131317.927883:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556736 00000100:00100000:3.0:1789131317.927967:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1789131317.927980:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556736:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789131317.928171:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556736:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 193us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131317.928181:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1789131317.930624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.930870:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556864 00000100:00100000:3.0:1789131317.930880:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556864 00000100:00100000:3.0:1789131317.930948:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1789131317.930959:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556864:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789131317.931001:0:9425:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789131317.931229:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556864:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 271us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131317.931239:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1789131317.934590:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131317.934734:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893556992 00000100:00100000:0.0:1789131317.934747:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893556992 00000100:00100000:0.0:1789131317.934813:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1789131317.934826:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556992:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131317.934925:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.934946:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.934960:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.934997:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935005:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935012:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935391:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935403:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935410:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131317.935569:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789131317.935575:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131317.935597:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935611:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935618:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935625:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935642:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131317.935647:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935698:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935715:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131317.935718:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131317.935724:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935731:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879049ea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935748:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935754:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935760:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935765:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131317.935768:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935773:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935791:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131317.935794:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131317.935797:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935803:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879049f1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935820:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935827:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935833:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935837:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131317.935840:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935846:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935854:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:0.0:1789131317.935856:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131317.935859:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.935865:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de371879049f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131317.935982:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893556992:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 1155us (1402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131317.935993:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1789131317.938162:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.938278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893557248 00000100:00100000:3.0:1789131317.938297:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893557248 00000100:00100000:3.0:1789131317.938389:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1789131317.938571:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893557248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131317.938612:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131317.938637:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879049ff lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396c4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.938858:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.938872:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.938883:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131317.938892:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789131317.939008:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939013:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939018:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939022:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.939026:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939032:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939059:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:3.0:1789131317.939069:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131317.939076:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939083:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939131:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879049ff lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396c4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939143:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:3.0:1789131317.939145:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131317.939149:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879049ff lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396c4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.939166:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ec00, rc 0) 00000100:00100000:3.0:1789131317.939244:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893557248:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 845us (1095us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789131317.939253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:1.0:1789131317.948538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.952228:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893557376 00000100:00100000:3.0:1789131317.952248:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893557376 00000100:00100000:3.0:1789131317.953071:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1789131317.953085:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893557376:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789131317.953378:0:5845:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789131317.953543:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893557376:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 461us (5017us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131317.953557:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:1.0:1789131317.962801:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131317.963212:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893557632 00000100:00100000:0.0:1789131317.963225:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893557632 00000100:00100000:0.0:1789131317.963306:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1789131317.963318:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893557632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131317.963366:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131317.963370:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131317.963408:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de371879049c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396b6 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.963429:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131317.963437:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131317.963453:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904a14 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396cb expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131317.968829:0:8131:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789131317.969229:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187904a1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.969251:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187904a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.969264:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187904a1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.969378:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904a14 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396cb expref: 20 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.969396:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187904a1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396cb expref: 19 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.969407:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131317.969410:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131317.969414:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14800, rc 0) 00000100:00100000:0.0:1789131317.969526:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10645:x1876039893557632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 6209us (6740us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789131317.969538:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1789131317.987870:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131317.987996:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893557888 00000100:00100000:3.0:1789131317.988022:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893557888 00000100:00100000:3.0:1789131317.988129:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1789131317.988142:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10645:x1876039893557888:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131317.988221:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131317.988257:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187904a1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396cb expref: 19 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988279:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392cb00) 00010000:00010000:3.0:1789131317.988293:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131317.988358:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988374:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988386:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988404:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988412:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988419:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988779:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988793:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988799:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.988805:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988814:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988823:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131317.988827:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.988831:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988838:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904a29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988848:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988855:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988861:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.988867:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131317.988870:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.989155:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.989166:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2a217657 (ffff9c0c431fa200) 00010000:00010000:3.0:1789131317.989168:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131317.989172:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131317.989178:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a30 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2a217657 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131317.989463:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893557888:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1320us (1604us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131317.989482:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1789131317.997690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131317.998293:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558016 00000100:00100000:0.0:1789131317.998306:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558016 00000100:00100000:0.0:1789131317.998483:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1789131317.998496:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10645:x1876039893558016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131317.998525:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131317.998555:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904a37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396d2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998601:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998618:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998632:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998781:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998802:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131317.998813:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131317.998817:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131317.998822:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131317.999522:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10645:x1876039893558016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1025us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131317.999533:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1789131318.010831:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.016732:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558272 00000100:00100000:1.0:1789131318.016752:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558272 00000100:00100000:1.0:1789131318.016842:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1789131318.016853:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10645:x1876039893558272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131318.016955:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.016978:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.016993:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131318.017594:0:8131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1789131318.017609:0:8131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 329991285958ns, next at 330991283309ns, rc = 0 00000004:00010000:1.0:1789131318.017718:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000030a48009 reply state 0000000067f0b12d transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.017730:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131318.017874:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10645:x1876039893558272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1019us (7056us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1789131318.017883:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1789131318.022619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.023463:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558400 00000100:00100000:3.0:1789131318.023485:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558400 00000100:00100000:3.0:1789131318.023562:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1789131318.023573:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10645:x1876039893558400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131318.023606:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131318.023633:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396d9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.023711:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.023729:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.023766:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:3.0:1789131318.023770:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131318.023776:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f200, rc 0) 00000100:00100000:3.0:1789131318.023849:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10645:x1876039893558400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 278us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.023857:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1789131318.026955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.027063:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558528 00000100:00100000:3.0:1789131318.027076:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558528 00000100:00100000:3.0:1789131318.027141:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1789131318.027151:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2351:x1876039893558528:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1789131318.027193:0:8327:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:3.0:1789131318.027233:0:8327:0:(genops.c:1385:class_connect()) connect: client 17aefd58-d436-480c-8fa4-256f2e59c9d4, cookie 0x9f0de37187904a53 00002000:00100000:3.0:1789131318.027248:0:8327:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 17aefd58-d436-480c-8fa4-256f2e59c9d4/ffff9c0c55d93800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789131318.027262:0:8327:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789131318.027757:0:8327:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789131318.027800:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0c55d91800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131318.027881:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2351:x1876039893558528:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 Request processed in 729us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.027892:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00010000:00010000:0.0:1789131318.028920:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.028939:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.028948:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.028955:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.028961:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.028970:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.029018:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.029021:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131318.029028:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.029034:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904a45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.034900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.034996:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558656 00000100:00100000:0.0:1789131318.035009:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558656 00000100:00100000:0.0:1789131318.035096:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1789131318.035108:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:0:x1876039893558656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789131318.035584:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131318.112779:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:0:x1876039893558656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 77655us (77878us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789131318.112797:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000001:00080000:0.0:1789131318.112846:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1789131318.112860:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000100:00100000:0.0:1789131318.115798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.116097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893558912 00000100:00100000:3.0:1789131318.116109:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893558912 00000100:00100000:3.0:1789131318.116178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1789131318.116190:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10645:x1876039893558912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131318.116550:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10645:x1876039893558912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 360us (763us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789131318.116559:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1789131318.124212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.125242:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559168 00000100:00100000:3.0:1789131318.125255:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559168 00000100:00100000:3.0:1789131318.125338:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1789131318.125349:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10645:x1876039893559168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789131318.125495:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10645:x1876039893559168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 148us (1294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.125503:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1789131318.134424:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131318.134536:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559296 00000100:00100000:2.0:1789131318.134548:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559296 00000100:00100000:2.0:1789131318.134624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1789131318.134634:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10645:x1876039893559296:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131318.134660:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131318.134687:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904a5a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396e0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134778:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134809:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131318.134852:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131318.134874:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134908:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904a5a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e0 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134927:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e0 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.134937:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131318.134940:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131318.134945:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea400, rc 0) 00000100:00100000:2.0:1789131318.135087:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10645:x1876039893559296:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 454us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.135105:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1789131318.141183:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.141267:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559424 00000100:00100000:3.0:1789131318.141282:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559424 00000100:00100000:3.0:1789131318.141385:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1789131318.141396:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893559424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131318.141419:0:8327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131318.141446:0:8327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396e7 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131318.141489:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3fa36, blocks: 0x1 00010000:00010000:3.0:1789131318.141512:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1789131318.141517:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131318.141528:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 6 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.141572:0:8327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 6 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.141589:0:8327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ec00, rc 0) 00000100:00100000:3.0:1789131318.141661:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893559424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 267us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.141670:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1789131318.151813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.152117:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559680 00000100:00100000:1.0:1789131318.152129:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559680 00000100:00100000:1.0:1789131318.152233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1789131318.152245:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10645:x1876039893559680:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789131318.152412:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10645:x1876039893559680:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 169us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.152421:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1789131318.157033:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.157142:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559808 00000100:00100000:1.0:1789131318.157154:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559808 00000100:00100000:1.0:1789131318.158416:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1789131318.158435:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:10645:x1876039893559808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131318.158462:0:6705:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131318.158495:0:6705:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396ee expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.158554:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 7 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.158565:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131318.158570:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131318.158575:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.158615:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 7 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.158632:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 7 pid: 8327 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.158648:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c4634fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1876039910362496:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131318.159002:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789131318.167806:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.168188:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893559936 00000100:00100000:3.0:1789131318.168201:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893559936 00010000:00010000:3.0:1789131318.168254:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 8 pid: 8327 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.168409:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1789131318.168421:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893559936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131318.168442:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131318.168482:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 8 pid: 8327 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.168498:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 8 pid: 8327 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.168534:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131318.168539:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131318.168550:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.168577:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.168629:0:8473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.168648:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742da580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910362624:192.168.203.52@tcp:105: 00000100:00100000:3.0:1789131318.168750:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0f00 going to sleep for 11 seconds 00010000:00010000:0.0:1789131318.169100:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f507279/0x9f0de37187904a68 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e7 expref: 8 pid: 8327 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.169121:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c4634fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1876039910362496:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131318.169154:0:6705:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.169178:0:6705:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:0.0:1789131318.169215:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10645:x1876039893559808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 10786us (12260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131318.169223:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1789131318.173828:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742da580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910362624:192.168.203.52@tcp:105: 00010000:00010000:1.0:1789131318.173864:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131318.173933:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893559936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 5513us (6142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.173946:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1789131318.178914:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.179055:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560064 00000100:00100000:1.0:1789131318.179068:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560064 00002000:00100000:1.0:1789131318.179129:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c0c742ce580 x1876039893560064/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:279/0 lens 504/0 e 0 to 0 dl 1789131329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131318.179148:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742ce580 with x1876039893560064 ext(0->8) 00002000:00010000:1.0:1789131318.179154:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c742ce580 00000100:00100000:1.0:1789131318.179219:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1789131318.179230:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893560064:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789131318.184614:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893560064:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 5377us (5705us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789131318.184627:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:1.0:1789131318.184639:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c0c742ce580 x1876039893560064/t4294967302(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:279/0 lens 504/448 e 0 to 0 dl 1789131329 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131318.184650:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742ce580 with x1876039893560064 ext(0->8) 00002000:00010000:1.0:1789131318.184658:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c742ce580 00000100:00100000:1.0:1789131318.189550:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.189601:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560192 00000100:00100000:1.0:1789131318.189613:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560192 00000100:00100000:1.0:1789131318.189681:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1789131318.189693:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10645:x1876039893560192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789131318.244258:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:0.0:1789131318.244292:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:0.0:1789131318.244297:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789131318.244340:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:0.0:1789131318.244454:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1789131318.244492:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1789131318.244502:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789131318.244675:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131318.244699:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910362752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789131318.244789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131318.244838:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910362752 00000100:00100000:1.0:1789131318.244846:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910362752 00000100:00100000:1.0:1789131318.244910:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789131318.244920:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910362752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789131318.245173:0:8327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789131318.245177:0:8327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789131318 00002000:00010000:1.0:1789131318.245179:0:8327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789131318.245182:0:8327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789131318 -> 1789131318 00002000:00010000:1.0:1789131318.245184:0:8327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789131318.245225:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910362752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (435us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789131318.245232:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789131318.245254:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789131318.245441:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c7a7f43c0/2, rc 0, transno 4294967303 00000100:00100000:1.0:1789131318.245448:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910362752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789131318.245711:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10645:x1876039893560192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 56017us (56173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.245720:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1789131318.253506:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.256643:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560320 00000100:00100000:3.0:1789131318.256662:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560320 00000100:00100000:3.0:1789131318.256793:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1789131318.256804:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893560320:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789131318.291191:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1789131318.291209:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1789131318.291422:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893560320:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 34611us (37922us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.291435:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1789131318.298824:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.298974:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560576 00000100:00100000:3.0:1789131318.298988:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560576 00000100:00100000:3.0:1789131318.299069:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1789131318.299080:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10645:x1876039893560576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789131318.299147:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131318.299179:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904a61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396e0 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.299215:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:3.0:1789131318.299220:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131318.299258:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.299274:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.299285:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131318.299667:0:5844:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f1a7218c reply state 0000000082663f14 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.299678:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131318.299798:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10645:x1876039893560576:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 718us (995us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789131318.299806:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00010000:00010000:1.0:1789131318.305636:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305655:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305664:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305671:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131318.305677:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305703:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305724:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131318.305727:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131318.305734:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.305741:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904a76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.306684:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.309133:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560704 00000100:00100000:3.0:1789131318.309151:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560704 00000100:00100000:3.0:1789131318.309261:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1789131318.309273:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893560704:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789131318.309630:0:8327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789131318.309635:0:8327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789131318 -> 1789131317 00002000:00010000:3.0:1789131318.309638:0:8327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789131316 00002000:00010000:3.0:1789131318.309641:0:8327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789131318 -> 1789131317 00002000:00010000:3.0:1789131318.309644:0:8327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789131318.309731:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893560704:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 459us (3056us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789131318.309740:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1789131318.323176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.323222:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893560960 00000100:00100000:3.0:1789131318.323234:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893560960 00000100:00100000:3.0:1789131318.323293:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:3.0:1789131318.323306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10645:x1876039893560960:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789131318.324133:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.324163:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.324174:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.324217:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.324235:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 13 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.324251:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910362880:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131318.325595:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c502769c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131318.332776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.333064:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910362880:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131318.333101:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.334576:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561088 00000100:00100000:0.0:1789131318.334592:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561088 00010000:00010000:0.0:1789131318.334644:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 14 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.334697:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131318.334710:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2353:x1876039893561088:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131318.334730:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131318.334741:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 14 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334756:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 14 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334784:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904a3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d2 expref: 14 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334809:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.334815:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334827:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334836:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.334874:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131318.334946:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2353:x1876039893561088:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 238us (2188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131318.334956:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00010000:00010000:3.0:1789131318.335203:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335213:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335248:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335255:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335263:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335276:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131318.335281:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335296:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335308:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:3.0:1789131318.335311:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789131318.335315:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.335341:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904a7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.335406:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:10645:x1876039893560960:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 12100us (12243us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789131318.335424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1789131318.349103:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.349388:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561216 00000100:00100000:0.0:1789131318.349402:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561216 00000100:00100000:0.0:1789131318.349488:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1789131318.349502:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893561216:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789131318.349578:0:6705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.349613:0:6705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.349623:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131318.349630:0:6705:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131318.349636:0:6705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.349691:0:6705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 7 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.349709:0:6705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 7 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.349730:0:6705:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1876039910363008:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131318.349853:0:6705:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131318.353719:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.354256:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561344 00000100:00100000:3.0:1789131318.354428:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561344 00010000:00010000:2.0:1789131318.354612:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.354704:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1789131318.354718:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893561344:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131318.354737:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131318.354768:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.354786:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.354797:0:6705:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aab6580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6705:1876039910363008:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131318.354822:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018f6583d/0x9f0de37187904a6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396ee expref: 8 pid: 6705 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.354833:0:6705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.354846:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131318.354852:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131318.354873:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.354884:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.356594:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131318.356624:0:6705:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356641:0:6705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356679:0:6705:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356689:0:6705:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356708:0:6705:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356715:0:6705:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131318.356720:0:6705:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356730:0:6705:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356750:0:6705:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.356759:0:6705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904a84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.356843:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893561216:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 7335us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.356844:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893561344:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2119us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.356861:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:2.0:1789131318.356863:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1789131318.358564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.359641:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561600 00000100:00100000:1.0:1789131318.359657:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561600 00000100:00100000:1.0:1789131318.359744:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1789131318.359757:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:10645:x1876039893561600:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131318.359867:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.359900:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.359915:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.360190:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.360202:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.360212:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.360250:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.360264:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 13 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.360279:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910363136:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131318.360413:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256600 going to sleep for 11 seconds 00000100:00100000:1.0:1789131318.368221:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910363136:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131318.368224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:1.0:1789131318.368267:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.368305:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561728 00000100:00100000:2.0:1789131318.368315:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561728 00010000:00010000:2.0:1789131318.368396:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 14 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.368440:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1789131318.368452:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2352:x1876039893561728:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131318.368483:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131318.368491:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 14 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368505:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 14 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368534:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904a4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396d9 expref: 14 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368551:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131318.368563:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368575:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368583:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.368616:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131318.368663:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.368679:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.368682:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2352:x1876039893561728:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.368699:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000001:00080000:1.0:1789131318.368930:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789131318.369107:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789131318.369155:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789131318.369271:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910363264:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131318.369354:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131318.369391:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910363264 00000100:00100000:2.0:1789131318.369397:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910363264 00000100:00100000:2.0:1789131318.369430:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131318.369437:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8131:x1876039910363264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131318.369518:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:8131:x1876039910363264:12345-0@lo:1000:mdt00_003.0 Request processed in 81us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.369526:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131318.370559:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131318.370592:0:8131:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789131318.370599:0:8131:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c7a7f43c0, transno 4294967303 00000100:00100000:1.0:1789131318.370626:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910363264:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789131318.371234:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789131318.371364:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910363392:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131318.371610:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131318.371651:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131318.371662:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910363392 00000100:00100000:3.0:1789131318.371671:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910363392 00000100:00100000:3.0:1789131318.371729:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131318.371741:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8131:x1876039910363392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789131318.372013:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910363392:12345-0@lo:1000:mdt00_003.0 Request processed in 272us (401us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789131318.372022:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131318.372118:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910363392:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789131318.372167:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372177:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372184:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372190:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.372195:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372202:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372218:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.372222:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131318.372233:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372240:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904a92 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372280:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372287:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372293:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372298:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.372300:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372306:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372314:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:0.0:1789131318.372317:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131318.372352:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372360:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de371879049c7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372389:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372537:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372557:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372595:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.372609:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 16 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.372623:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aab43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910363520:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131318.372711:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9df00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131318.375406:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aab43c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910363520:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131318.375435:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.376105:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.378288:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893561856 00000100:00100000:3.0:1789131318.378306:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893561856 00010000:00010000:3.0:1789131318.378380:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 17 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.378495:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1789131318.378509:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:2352:x1876039893561856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131318.378538:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131318.378547:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 17 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378572:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 17 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378610:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de371879049e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396bd expref: 17 pid: 5846 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378635:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:3.0:1789131318.378642:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378655:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378665:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.378702:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131318.378770:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:2352:x1876039893561856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 264us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.378779:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00010000:00010000:2.0:1789131318.378835:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378846:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378861:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378869:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378887:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378894:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131318.378899:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378909:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378920:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:2.0:1789131318.378923:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131318.378927:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378934:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904a99 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378946:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378953:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378959:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378965:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131318.378967:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378984:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.378993:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35600) 00010000:00010000:2.0:1789131318.378996:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131318.378999:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.379005:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904a8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.380443:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10645:x1876039893561600:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 20677us (21878us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1789131318.380461:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000020:00080000:2.0:1789131318.380478:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789131318.380648:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131318.380654:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131318.380700:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789131318.380706:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131318.382923:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131318.382989:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893562112 00000100:00100000:2.0:1789131318.383001:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893562112 00000100:00100000:2.0:1789131318.383066:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1789131318.383078:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10645:x1876039893562112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789131318.384898:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789131318.385020:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1789131318.385083:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385103:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385127:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385139:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385146:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385153:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.385306:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131318.385478:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10645:x1876039893562112:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 2389us (2553us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1789131318.385489:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000020:00080000:2.0:1789131318.385497:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131318.386939:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131318.386952:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.386962:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131318.386967:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.386977:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.386997:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:3.0:1789131318.387000:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789131318.387005:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.387021:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.387752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131318.387757:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131318.387760:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131318.449408:0:12424:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131318.449421:0:12424:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131318.449476:0:12424:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789131318.449484:0:12424:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131318.614948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131318.614999:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893562368 00000100:00100000:2.0:1789131318.615010:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893562368 00000100:00100000:2.0:1789131318.615075:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1789131318.615086:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:10655:x1876039893562368:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131318.615118:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131318.615145:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396f5 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.615866:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904aae lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.615897:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904aae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.615911:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904aae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131318.615926:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1789131318.616139:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904aa7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396f5 expref: 20 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.616159:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904aae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396f5 expref: 19 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.616169:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131318.616172:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131318.616176:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceae00, rc 0) 00000100:00100000:2.0:1789131318.618737:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10655:x1876039893562368:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3636us (3789us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1789131318.618754:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1789131318.629838:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.629886:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893562496 00000100:00100000:3.0:1789131318.629900:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893562496 00000100:00100000:3.0:1789131318.629968:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1789131318.629980:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10655:x1876039893562496:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1789131318.630090:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.630113:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.630128:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.630146:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.630154:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.630160:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631203:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631219:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631230:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131318.631410:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631428:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631436:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631444:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631453:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131318.631458:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631477:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631493:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131318.631496:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131318.631501:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631518:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631600:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631607:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631614:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631619:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131318.631623:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631632:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631640:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c431fa100) 00010000:00010000:3.0:1789131318.631643:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131318.631647:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631653:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631675:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631681:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631694:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631698:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131318.631701:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631707:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631714:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c431fa900) 00010000:00010000:3.0:1789131318.631716:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131318.631719:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131318.631725:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.631852:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10655:x1876039893562496:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1869us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131318.631864:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1789131318.669029:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.669173:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893562752 00000100:00100000:0.0:1789131318.669187:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893562752 00000100:00100000:0.0:1789131318.669292:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1789131318.669304:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:10658:x1876039893562752:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131318.669373:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131318.669403:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904ad1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0396fc expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669516:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669556:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669571:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669591:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669598:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669605:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.669994:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670004:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670012:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131318.670024:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1789131318.670140:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670150:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670157:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670171:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.670176:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670185:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670200:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131318.670203:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131318.670209:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670216:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904ad8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670232:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670238:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670245:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670251:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.670253:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670260:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670279:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c4392c600) 00010000:00010000:0.0:1789131318.670282:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131318.670285:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670293:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904adf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670381:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904ad1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 22 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670398:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 21 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.670406:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.670409:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131318.670412:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131318.670504:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10658:x1876039893562752:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1201us (1489us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1789131318.670514:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:1.0:1789131318.678006:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131318.679157:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893562880 00000100:00100000:3.0:1789131318.679175:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893562880 00000100:00100000:3.0:1789131318.679274:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1789131318.679294:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10658:x1876039893562880:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1789131318.679491:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679538:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679597:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679605:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679611:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679618:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131318.679623:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679631:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679647:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131318.679650:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131318.679656:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.679663:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904af4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.679924:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10658:x1876039893562880:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 637us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.679935:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1789131318.685048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.685224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893563136 00000100:00100000:0.0:1789131318.685237:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893563136 00000100:00100000:0.0:1789131318.685305:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1789131318.685317:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10658:x1876039893563136:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131318.685818:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10658:x1876039893563136:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 500us (781us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789131318.685828:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:3.0:1789131318.744474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131318.746134:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893563392 00000100:00100000:2.0:1789131318.746150:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893563392 00000100:00100000:0.0:1789131318.746313:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:0.0:1789131318.746356:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:10188:x1876039893563392:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131318.746390:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131318.746417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904afb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039703 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.746624:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.746642:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 23 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.746663:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.746708:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 23 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.746724:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 23 pid: 8131 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.746741:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aab4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910363648:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131318.746876:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131318.752491:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aab4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910363648:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131318.752536:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.754049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.754178:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893563520 00000100:00100000:0.0:1789131318.754194:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893563520 00010000:00010000:0.0:1789131318.754247:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 24 pid: 8131 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.754500:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1789131318.754514:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:2352:x1876039893563520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131318.754535:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131318.754544:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 24 pid: 8131 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754560:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 24 pid: 8131 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754669:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904ae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396fc expref: 24 pid: 8131 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754690:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.754696:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754707:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754715:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.754808:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131318.754885:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:2352:x1876039893563520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 373us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131318.754906:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00010000:00010000:1.0:1789131318.756092:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.756112:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131318.756142:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789131318.756801:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904afb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.756845:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.756856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131318.756860:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131318.756864:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14400, rc 0) 00000100:00100000:1.0:1789131318.757013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10188:x1876039893563392:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10659us (12562us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789131318.757024:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1789131318.765670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.773033:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893563776 00000100:00100000:0.0:1789131318.773055:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893563776 00000100:00100000:0.0:1789131318.773184:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:0.0:1789131318.773198:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10188:x1876039893563776:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1789131318.773759:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.773782:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.773796:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131318.773862:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789131318.774136:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000227a0562 reply state 000000000f54b68a transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131318.774148:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789131318.774211:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789131318.774548:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10188:x1876039893563776:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1350us (8890us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789131318.774558:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000020:00080000:0.0:1789131318.774565:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789131318.777745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:0.0:1789131318.777864:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.777878:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.777918:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.777925:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.777931:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.778060:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.778080:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.778084:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131318.778089:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.778097:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904b10 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.784609:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893563904 00000100:00100000:3.0:1789131318.784796:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893563904 00000100:00100000:2.0:1789131318.790032:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:2.0:1789131318.790052:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:10188:x1876039893563904:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131318.790090:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131318.790119:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904b17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03970a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.790211:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03970a expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.790228:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03970a expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.790252:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131318.790256:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131318.790260:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebe00, rc 0) 00000100:00100000:2.0:1789131318.790415:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10188:x1876039893563904:12345-192.168.203.52@tcp:101:bash.0 Request processed in 367us (12685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.790422:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:2.0:1789131318.798633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.798748:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564032 00000100:00100000:0.0:1789131318.798761:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564032 00000100:00100000:0.0:1789131318.798833:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1789131318.798844:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:10188:x1876039893564032:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131318.798867:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131318.798895:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039711 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131318.798928:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3fa35, atime: 0x6aa3fa34, ctime: 0x6aa3fa35, blocks: 0xb 00010000:00010000:0.0:1789131318.799019:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1789131318.799025:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131318.799053:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.799077:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.799092:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131318.799166:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10188:x1876039893564032:12345-192.168.203.52@tcp:101:bash.0 Request processed in 323us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131318.799174:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1789131318.801652:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.802008:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564160 00000100:00100000:1.0:1789131318.802020:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564160 00002000:00010000:1.0:1789131318.802075:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789131318.802081:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742da1c0 with x1876039893564160 ext(0->18446744073709551615) 00002000:00010000:1.0:1789131318.802096:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c742da1c0. 00000100:00100000:1.0:1789131318.802137:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1789131318.802148:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893564160:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:1.0:1789131318.802744:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789131318.802750:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789131317 -> 1789131319 00002000:00010000:1.0:1789131318.802753:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789131316 -> 1789131316 00002000:00010000:1.0:1789131318.802756:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789131317 -> 1789131319 00002000:00010000:1.0:1789131318.802758:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789131318.802932:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893564160:12345-192.168.203.52@tcp:10:bash.0 Request processed in 781us (1290us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789131318.802942:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00010000:1.0:1789131318.802974:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1789131318.802978:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742da1c0 with x1876039893564160 ext(0->18446744073709551615) 00002000:00010000:1.0:1789131318.802984:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c742da1c0. 00000100:00100000:2.0:1789131318.872869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.873058:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564288 00000100:00100000:1.0:1789131318.873071:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564288 00010000:00010000:0.0:1789131318.873520:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131318.873842:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1789131318.873856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10672:x1876039893564288:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1789131318.873981:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874004:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874017:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874033:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874040:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874046:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874505:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874517:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874526:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131318.874595:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874608:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874615:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874622:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874629:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131318.874633:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874642:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874657:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131318.874661:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131318.874666:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874673:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874688:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874695:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874707:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874713:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131318.874716:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874723:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874732:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35200) 00010000:00010000:1.0:1789131318.874735:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131318.874737:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874743:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874760:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874767:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874773:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874778:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131318.874782:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874798:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874807:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131318.874809:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131318.874813:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.874819:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.874930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10672:x1876039893564288:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1074us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.874940:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1789131318.918234:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.919430:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564544 00000100:00100000:0.0:1789131318.919447:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564544 00000100:00100000:0.0:1789131318.919538:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:0.0:1789131318.919548:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:10675:x1876039893564544:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131318.919623:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131318.919653:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904b3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039718 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919755:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919774:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919787:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919803:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919826:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.919832:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.921554:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904b4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.921634:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.921648:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904b4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131318.922054:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789131318.922191:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922200:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922209:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922215:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.922221:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922229:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922257:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131318.922260:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131318.922266:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922273:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904b41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922287:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922294:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922299:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922304:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131318.922306:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922311:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922318:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131318.922453:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131318.922458:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922474:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904b48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922549:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904b3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039718 expref: 30 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922788:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904b4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039718 expref: 29 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131318.922795:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131318.922797:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789131318.922799:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131318.923021:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10675:x1876039893564544:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3471us (4801us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789131318.923032:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1789131318.926453:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131318.928628:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564672 00000100:00100000:2.0:1789131318.928647:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564672 00000100:00100000:2.0:1789131318.928743:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:2.0:1789131318.928756:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10675:x1876039893564672:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1789131318.928883:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.928904:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.928914:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.929515:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.929533:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 29 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.929553:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876039910363776:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131318.929786:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131318.936748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.937297:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876039910363776:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131318.937375:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131318.938382:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893564928 00000100:00100000:3.0:1789131318.938397:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893564928 00000100:00100000:3.0:1789131318.938503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1789131318.938517:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:5589:x1876039893564928:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789131318.939797:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:5589:x1876039893564928:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 1275us (3062us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789131318.939810:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1789131318.943955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131318.944101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893565056 00000100:00100000:1.0:1789131318.944116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893565056 00010000:00010000:1.0:1789131318.944175:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 31 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131318.944268:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1789131318.944280:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:2352:x1876039893565056:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131318.944298:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131318.944308:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 31 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944366:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 31 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944505:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904b02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039703 expref: 31 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944527:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131318.944533:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944545:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944555:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131318.944730:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131318.944859:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:2352:x1876039893565056:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 579us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131318.944869:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00010000:00010000:2.0:1789131318.944951:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.944960:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945003:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945011:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945032:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945039:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131318.945044:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945052:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945064:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131318.945068:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131318.945072:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131318.945079:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131318.945127:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10675:x1876039893564672:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 16373us (18695us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131318.945136:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1789131318.948235:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131318.948374:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893565312 00000100:00100000:0.0:1789131318.948391:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893565312 00000100:00100000:0.0:1789131318.948482:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1789131318.948496:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:10675:x1876039893565312:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131318.948868:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10675:x1876039893565312:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 374us (647us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789131318.948877:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1789131319.012722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.012918:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893565568 00000100:00100000:1.0:1789131319.012932:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893565568 00000100:00100000:1.0:1789131319.013036:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1789131319.013049:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:10686:x1876039893565568:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1789131319.013078:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.013107:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03971f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013213:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013243:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013258:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013290:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013298:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013305:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013785:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013797:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013806:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131319.013818:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789131319.013938:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013948:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013956:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013969:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.013974:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013983:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.013998:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131319.014001:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131319.014007:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014014:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014028:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014034:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014040:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014045:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.014048:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014054:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014072:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35200) 00010000:00010000:1.0:1789131319.014075:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131319.014078:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789131319.014368:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131319.014823:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03971f expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014853:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03971f expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.014864:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131319.014867:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131319.014871:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:1.0:1789131319.014985:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:10686:x1876039893565568:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1938us (2274us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789131319.014995:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1789131319.022566:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.022732:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893565824 00000100:00100000:3.0:1789131319.022746:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893565824 00000100:00100000:3.0:1789131319.022851:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1789131319.022863:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:10686:x1876039893565824:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:3.0:1789131319.023233:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10686:x1876039893565824:12345-192.168.203.52@tcp:35:cat.0 Request processed in 371us (982us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789131319.023243:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1789131319.042723:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.042798:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.042844:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.042888:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.042981:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566336 00000100:00100000:1.0:1789131319.042994:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566336 00000100:00100000:1.0:1789131319.043081:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1789131319.043095:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893566336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131319.043187:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893566336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.043195:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1789131319.043685:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566080 00000100:00100000:0.0:1789131319.043691:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566080 00000100:00080000:2.0:1789131319.043792:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131319.044080:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566464 00000100:00100000:0.0:1789131319.044084:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566464 00000100:00080000:2.0:1789131319.044152:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131319.044353:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566208 00000100:00100000:3.0:1789131319.044359:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566208 00000100:00100000:3.0:1789131319.044395:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:3.0:1789131319.044404:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893566208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131319.044472:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893566208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 58us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.044480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 313 00000100:00100000:1.0:1789131319.045113:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:1.0:1789131319.045129:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893566464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131319.045175:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893566464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.045182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:1.0:1789131319.045202:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1789131319.045209:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10687:x1876039893566080:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:1.0:1789131319.045402:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131319.045447:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03971f expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045493:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904b4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039718 expref: 32 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045508:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904b17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03970a expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045519:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131319.045532:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131319.045562:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045577:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045588:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045621:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045629:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.045635:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.046876:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.046892:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.046902:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131319.050002:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1789131319.050022:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331023699849ns, next at 332023695698ns, rc = 0 00010000:00010000:1.0:1789131319.050133:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050154:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050170:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050179:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050203:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050209:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050236:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131319.050520:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131319.050530:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.050538:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131319.050543:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.050552:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.050569:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:3.0:1789131319.050573:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789131319.050579:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.050585:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904b9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.050599:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131319.050601:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131319.050603:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131319.050737:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050744:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050750:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050755:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.050758:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050764:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050773:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:1.0:1789131319.050775:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789131319.050778:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050783:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904b95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050811:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050825:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050830:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050835:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.050838:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050844:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050852:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131319.050854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131319.050857:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.050862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904b87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131319.050878:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005969469c reply state 00000000dc875671 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.050888:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131319.051048:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:10687:x1876039893566080:12345-192.168.203.52@tcp:36:rm.0 Request processed in 5832us (8334us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789131319.051059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00010000:00010000:1.0:1789131319.055751:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055800:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055808:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055815:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.055821:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055830:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055850:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35200) 00010000:00010000:1.0:1789131319.055854:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131319.055860:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.055867:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904b8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.096588:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.096766:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566720 00000100:00100000:1.0:1789131319.096783:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566720 00000100:00100000:1.0:1789131319.097010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:1.0:1789131319.097022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:10693:x1876039893566720:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131319.097055:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.097082:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904ba3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039726 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097910:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097928:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097940:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097952:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097956:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.097960:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131319.099009:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789131319.099370:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099382:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099390:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099423:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099443:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099451:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099457:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.099472:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099482:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099498:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:1.0:1789131319.099502:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131319.099508:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.099514:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904baa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131319.099534:0:5844:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a074531f reply state 00000000f3f7c474 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.099545:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789131319.101086:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904ba3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.101118:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.101150:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:1.0:1789131319.101153:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131319.101157:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:1.0:1789131319.101260:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:10693:x1876039893566720:12345-192.168.203.52@tcp:101:bash.0 Request processed in 4239us (4685us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789131319.101273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1789131319.106416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.106492:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566848 00000100:00100000:1.0:1789131319.106506:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566848 00000100:00100000:1.0:1789131319.106597:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131319.106610:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893566848:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131319.106634:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.106661:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03972d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106668:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106685:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106694:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106702:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00002000:00010000:1.0:1789131319.106702:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131319.106708:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106734:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.106749:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789131319.106756:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35200) 00010000:00010000:1.0:1789131319.106756:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131319.106761:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131319.106769:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.106776:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.106781:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.106813:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 6 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.106828:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:1.0:1789131319.106915:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45c3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893566848:12345-192.168.203.52@tcp:101:bash.0 Request processed in 306us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.106929:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1789131319.110794:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.110899:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893566976 00000100:00100000:1.0:1789131319.110981:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893566976 00000100:00100000:1.0:1789131319.111057:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:1.0:1789131319.111068:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:10693:x1876039893566976:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131319.111093:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.111116:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039734 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.111154:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.111165:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131319.111181:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131319.111189:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.111233:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.111249:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.111265:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1876039910363904:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131319.113041:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256480 going to sleep for 11 seconds 00000100:00100000:1.0:1789131319.123774:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6706:1876039910363904:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131319.123824:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.123852:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7800, rc 0) 00000100:00100000:1.0:1789131319.125068:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:10693:x1876039893566976:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13992us (14280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.125082:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1789131319.128561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.128684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893567104 00000100:00100000:2.0:1789131319.128714:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893567104 00010000:00010000:2.0:1789131319.128772:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.128868:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1789131319.128881:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893567104:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131319.128900:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131319.128941:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.128958:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.128988:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018f6583d/0x9f0de37187904bc6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03972d expref: 7 pid: 6704 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.129016:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131319.129021:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131319.129031:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.129042:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.129094:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.129125:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876039910364032:192.168.203.52@tcp:105: 00000100:00100000:2.0:1789131319.129237:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131319.137220:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0a580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1876039910364032:192.168.203.52@tcp:105: 00010000:00010000:0.0:1789131319.137268:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131319.137375:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893567104:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 8495us (8829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131319.137388:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1789131319.138986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.139292:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893567360 00000100:00100000:1.0:1789131319.139303:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893567360 00000100:00100000:1.0:1789131319.139396:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1789131319.139409:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:10693:x1876039893567360:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1789131319.139870:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:10693:x1876039893567360:12345-192.168.203.52@tcp:35:bash.0 Request processed in 461us (895us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789131319.139879:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:0.0:1789131319.289160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.289307:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893567488 00000100:00100000:3.0:1789131319.289353:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893567488 00000100:00100000:3.0:1789131319.289433:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1789131319.289444:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:10709:x1876039893567488:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131319.289492:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131319.289523:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904bd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03973b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289611:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289628:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289641:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131319.289721:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1789131319.289744:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131319.289781:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289812:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904bd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03973b expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289835:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03973b expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.289846:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131319.289850:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131319.289854:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fa00, rc 0) 00000100:00100000:3.0:1789131319.290004:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:10709:x1876039893567488:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 561us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.290012:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:0.0:1789131319.294444:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.295245:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893567744 00000100:00100000:2.0:1789131319.295259:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893567744 00000100:00100000:2.0:1789131319.295539:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:2.0:1789131319.295550:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:10709:x1876039893567744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131319.295576:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131319.295604:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039742 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.295790:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.295809:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.295822:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131319.295835:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789131319.296077:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039742 expref: 38 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.296101:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039742 expref: 37 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.296136:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:2.0:1789131319.296139:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131319.296144:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb000, rc 0) 00000100:00100000:2.0:1789131319.296299:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:10709:x1876039893567744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 749us (1869us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1789131319.296307:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:2.0:1789131319.300218:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.300380:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568000 00000100:00100000:1.0:1789131319.300391:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568000 00000100:00100000:1.0:1789131319.300477:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:1.0:1789131319.300488:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:10709:x1876039893568000:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131319.300520:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.300550:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904bf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039749 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.300673:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.300690:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.300721:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131319.300737:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789131319.300894:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904bf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039749 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.300921:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039749 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.300931:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:1.0:1789131319.300934:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789131319.300938:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7600, rc 0) 00000100:00100000:1.0:1789131319.301136:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:10709:x1876039893568000:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 648us (931us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789131319.301146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1789131319.304591:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.304727:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568128 00000100:00100000:1.0:1789131319.304739:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568128 00000100:00100000:1.0:1789131319.304819:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1789131319.304831:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:2352:x1876039893568128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131319.304851:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131319.304885:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039742 expref: 39 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.304908:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:1.0:1789131319.304913:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131319.305021:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:2352:x1876039893568128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 191us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.305031:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1789131319.309506:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.309796:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568256 00000100:00100000:3.0:1789131319.309810:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568256 00000100:00100000:3.0:1789131319.309896:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1789131319.309908:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893568256:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1789131319.309971:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.309997:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.310008:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131319.310091:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131319.310097:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.310145:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.310162:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 6 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.310179:0:8327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742d8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910364160:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131319.310392:0:8327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0780 going to sleep for 11 seconds 00000100:00100000:3.0:1789131319.323206:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.323436:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568384 00000100:00100000:1.0:1789131319.323448:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568384 00002000:00100000:1.0:1789131319.323526:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c0c742d8780 x1876039893568384/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:280/0 lens 504/0 e 0 to 0 dl 1789131330 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131319.323538:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742d8780 with x1876039893568384 ext(0->8) 00010000:00010000:1.0:1789131319.323548:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 7 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.323568:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 7 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131319.323577:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742d8780 00000100:00100000:1.0:1789131319.323620:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1789131319.323631:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893568384:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:0.0:1789131319.324160:0:8327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742d8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910364160:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131319.324195:0:8327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.325468:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893568384:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 1820us (2257us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789131319.325482:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00100000:1.0:1789131319.325497:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c0c742d8780 x1876039893568384/t4294967302(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:280/0 lens 504/448 e 0 to 0 dl 1789131330 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131319.325507:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742d8780 with x1876039893568384 ext(0->8) 00010000:00010000:1.0:1789131319.325517:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.325555:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131319.325564:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742d8780 00000100:00100000:0.0:1789131319.334045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.334153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568512 00000100:00100000:3.0:1789131319.334166:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568512 00010000:00010000:3.0:1789131319.334315:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.334409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1789131319.334422:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2355:x1876039893568512:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131319.334443:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789131319.334479:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789131319.334483:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789131319 00002000:00010000:3.0:1789131319.334485:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789131319 00002000:00010000:3.0:1789131319.334488:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789131319 00010000:00010000:3.0:1789131319.334495:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.334535:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.334566:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a452d9ff/0x9f0de37187904bcd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039734 expref: 9 pid: 6706 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.334588:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131319.334593:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131319.334600:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.334611:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.334672:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131319.335385:0:8327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335399:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335432:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335440:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335448:0:8327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335454:0:8327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131319.335469:0:8327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335478:0:8327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335507:0:8327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.335515:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de37187904c0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.336839:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2355:x1876039893568512:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2405us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.336856:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1789131319.338747:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893568256:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 28825us (29241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.338764:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1789131319.341376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.341418:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568768 00000100:00100000:1.0:1789131319.341433:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568768 00000100:00100000:1.0:1789131319.341517:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1789131319.341529:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:10709:x1876039893568768:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:1.0:1789131319.341632:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039749 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131319.342230:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1789131319.342297:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1789131319.344607:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1789131319.345514:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.345542:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.345553:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.345629:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.345647:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 42 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.345677:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910364288:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131319.345802:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256480 going to sleep for 11 seconds 00000100:00100000:2.0:1789131319.349596:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.349842:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893568896 00000100:00100000:3.0:1789131319.349854:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893568896 00010000:00010000:3.0:1789131319.349970:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 43 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.350020:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1789131319.350033:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:2353:x1876039893568896:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131319.350074:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131319.350083:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 43 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.350098:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 43 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.350127:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:3.0:1789131319.350133:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.350143:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.350152:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.350558:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904bb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039726 expref: 43 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.350588:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910364288:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131319.350615:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.351255:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131319.351305:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.351314:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131319.351522:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1789131319.351776:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1789131319.352616:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:2353:x1876039893568896:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2576us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131319.352630:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1789131319.353673:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910364416:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789131319.353747:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131319.353796:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c452560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131319.354189:0:12380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910364416 00000100:00100000:3.0:1789131319.354200:0:12380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910364416 00000100:00100000:3.0:1789131319.354432:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131319.354444:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5847:x1876039910364416:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131319.354572:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5847:x1876039910364416:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 130us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.354580:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131319.354760:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910364416:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789131319.355413:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789131319.355525:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910364544:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789131319.355572:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131319.355607:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256480 going to sleep for 11 seconds 00000100:00080000:2.0:1789131319.355767:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131319.356070:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910364544 00000100:00100000:3.0:1789131319.356078:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910364544 00000100:00100000:3.0:1789131319.356137:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789131319.356148:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1876039910364544:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789131319.356444:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5847:x1876039910364544:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 297us (869us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789131319.356452:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131319.356717:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910364544:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789131319.356800:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1789131319.356850:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356862:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356871:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356878:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a6c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131319.356883:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356904:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356926:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:1.0:1789131319.356929:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789131319.356935:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.356943:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131319.357169:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789131319.358069:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789131319.358086:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331331763866ns, next at 332331760463ns, rc = 0 00000001:00080000:0.0:1789131319.358099:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789131319.358152:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35700) 00010000:00010000:0.0:1789131319.358156:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131319.358177:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904bfe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039749 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.358383:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:10709:x1876039893568768:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 16855us (17061us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789131319.358393:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000020:00080000:0.0:1789131319.358400:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789131319.367270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.367423:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893569024 00000100:00100000:1.0:1789131319.367436:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893569024 00000100:00100000:1.0:1789131319.367512:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1789131319.367523:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:10709:x1876039893569024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131319.367553:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.367582:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904c1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039750 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.367659:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904c1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039750 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.367675:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904c1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039750 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.367697:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:1.0:1789131319.367700:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131319.367705:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:1.0:1789131319.367779:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:10709:x1876039893569024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 258us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.367787:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:3.0:1789131319.373010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.373441:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893569280 00000100:00100000:0.0:1789131319.373454:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893569280 00000100:00100000:0.0:1789131319.373580:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1789131319.373594:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:10709:x1876039893569280:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131319.373933:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10709:x1876039893569280:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 341us (1076us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1789131319.373943:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000040:00080000:2.0:1789131319.386074:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131319.386086:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131319.386125:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789131319.386132:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131319.458253:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.458389:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893569408 00000100:00100000:0.0:1789131319.458402:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893569408 00000100:00100000:0.0:1789131319.458487:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:0.0:1789131319.458499:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10719:x1876039893569408:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1789131319.458612:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.458635:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.458783:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.458806:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.458839:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.458847:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459046:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459055:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459063:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131319.459121:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459139:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459146:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459153:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459160:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131319.459166:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459174:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459198:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131319.459201:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131319.459207:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459214:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459231:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459237:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459242:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459248:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131319.459250:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459256:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459264:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131319.459266:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131319.459269:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.459275:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460758:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460770:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460777:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460784:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131319.460789:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460797:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460814:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131319.460817:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131319.460822:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.460828:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.462036:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10719:x1876039893569408:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 3524us (3782us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131319.462052:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1789131319.499418:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.499623:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893569664 00000100:00100000:3.0:1789131319.499638:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893569664 00000100:00100000:3.0:1789131319.499724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1789131319.499737:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:10722:x1876039893569664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131319.499768:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131319.499799:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904c36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039757 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499917:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499937:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499951:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499969:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499978:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.499985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500192:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500202:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500209:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131319.500220:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789131319.500398:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500406:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500414:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500420:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131319.500425:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500433:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500447:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:3.0:1789131319.500451:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131319.500465:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500484:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187904c3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500501:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500506:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500511:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500515:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131319.500518:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500524:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500531:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c431fa900) 00010000:00010000:3.0:1789131319.500534:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131319.500536:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500542:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187904c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500590:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904c36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500605:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.500619:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131319.500622:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131319.500624:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f400, rc 0) 00000100:00100000:3.0:1789131319.500712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10722:x1876039893569664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 976us (1311us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1789131319.500721:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1789131319.505468:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.506307:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893569792 00000100:00100000:2.0:1789131319.506347:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893569792 00000100:00100000:2.0:1789131319.506428:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:2.0:1789131319.506439:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10722:x1876039893569792:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1789131319.506552:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506601:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506616:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506653:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506660:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506668:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506677:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131319.506683:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506693:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506707:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131319.506711:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131319.506718:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.506726:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904c59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.506824:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10722:x1876039893569792:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 386us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131319.506840:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:0.0:1789131319.510557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.512149:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570048 00000100:00100000:3.0:1789131319.512169:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570048 00000100:00100000:3.0:1789131319.512272:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1789131319.512285:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:10722:x1876039893570048:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131319.512670:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:10722:x1876039893570048:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 385us (2128us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789131319.512679:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1789131319.599039:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.599614:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570304 00000100:00100000:0.0:1789131319.599629:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570304 00000100:00100000:0.0:1789131319.599738:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:0.0:1789131319.599753:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:10732:x1876039893570304:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131319.599793:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131319.599797:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131319.599850:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187904bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03973b expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.599883:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131319.599899:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131319.599921:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03975e expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.600065:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.600083:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.600094:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.600138:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.600154:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 50 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.600702:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910364672:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131319.600856:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131319.605712:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.605851:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910364672:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131319.605889:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.607540:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570432 00000100:00100000:3.0:1789131319.607558:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570432 00010000:00010000:3.0:1789131319.607625:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 51 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.607685:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1789131319.607697:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:2353:x1876039893570432:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131319.607717:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131319.607725:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 51 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607770:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 51 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607801:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039757 expref: 51 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607824:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131319.607832:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607843:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607852:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.607885:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131319.607982:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:2353:x1876039893570432:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 287us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.607991:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:0.0:1789131319.608157:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.608168:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131319.608208:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789131319.608439:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 51 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.608470:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 50 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.608478:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131319.608481:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131319.608485:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15c00, rc 0) 00000100:00100000:0.0:1789131319.608517:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:10732:x1876039893570304:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8768us (9499us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789131319.608524:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:3.0:1789131319.612209:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.612319:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570688 00000100:00100000:1.0:1789131319.612380:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570688 00000100:00100000:1.0:1789131319.612445:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:1.0:1789131319.612467:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:10732:x1876039893570688:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1789131319.612858:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.612892:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.612905:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131319.612969:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789131319.612996:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009f293d78 reply state 000000006198b606 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.613007:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131319.613124:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:10732:x1876039893570688:12345-192.168.203.52@tcp:36:bash.0 Request processed in 667us (929us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789131319.613134:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000020:00080000:1.0:1789131319.613140:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789131319.627147:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627171:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627180:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627209:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131319.627215:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627224:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627247:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131319.627250:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131319.627257:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.627264:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904c75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.630047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.630164:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570816 00000100:00100000:1.0:1789131319.630177:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570816 00000100:00100000:1.0:1789131319.630252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1789131319.630265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:10732:x1876039893570816:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131319.630300:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131319.630366:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039765 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.630495:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.630512:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 53 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.630544:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.630588:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 53 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.630605:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 53 pid: 8131 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131319.630621:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910364800:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131319.630746:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256900 going to sleep for 11 seconds 00000100:00100000:0.0:1789131319.638232:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910364800:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131319.638274:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.638832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.638938:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893570944 00000100:00100000:2.0:1789131319.638949:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893570944 00010000:00010000:2.0:1789131319.638998:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 54 pid: 8131 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.639047:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1789131319.639058:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:2352:x1876039893570944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131319.639076:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131319.639084:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 54 pid: 8131 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639097:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 54 pid: 8131 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639124:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904c67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03975e expref: 54 pid: 8131 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639146:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131319.639152:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639163:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639182:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.639229:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131319.639296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:2352:x1876039893570944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 239us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131319.639305:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00010000:00010000:0.0:1789131319.639622:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.639631:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131319.639695:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789131319.639700:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131319.639728:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.639769:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904c7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.639791:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.639800:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131319.639803:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131319.639806:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7600, rc 0) 00000100:00100000:0.0:1789131319.639839:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:10732:x1876039893570816:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9578us (9807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131319.639847:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1789131319.645958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.646232:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571200 00000100:00100000:3.0:1789131319.646245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571200 00000100:00100000:3.0:1789131319.646482:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1789131319.646495:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:10732:x1876039893571200:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1789131319.647090:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:10732:x1876039893571200:12345-192.168.203.52@tcp:35:bash.0 Request processed in 595us (1505us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789131319.647101:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1789131319.734823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.735799:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571328 00000100:00100000:0.0:1789131319.735816:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571328 00000100:00100000:0.0:1789131319.736020:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:0.0:1789131319.736033:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:10738:x1876039893571328:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131319.736068:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131319.736111:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03976c expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736216:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736234:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736249:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131319.736485:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1789131319.736490:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131319.736591:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736625:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904c8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03976c expref: 55 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736646:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03976c expref: 54 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.736998:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131319.737001:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131319.737006:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:0.0:1789131319.737097:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893571328:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1066us (2289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131319.737106:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1789131319.741494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131319.742113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571456 00000100:00100000:2.0:1789131319.742126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571456 00000100:00100000:2.0:1789131319.742195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1789131319.742206:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893571456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131319.742232:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131319.742265:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904c98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039773 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742364:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742381:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742395:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742410:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742417:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742423:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742592:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742602:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.742608:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131319.743001:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789131319.743008:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131319.743039:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743054:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743064:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743070:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743077:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743084:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131319.743089:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743099:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743123:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131319.743127:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131319.743134:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743141:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904c9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743158:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743166:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743172:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743177:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131319.743180:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743187:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743194:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c5855bb00) 00010000:00010000:2.0:1789131319.743196:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131319.743199:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743206:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904ca6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743376:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904c98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039773 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743393:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039773 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.743401:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131319.743403:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131319.743406:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebe00, rc 0) 00000100:00100000:2.0:1789131319.743507:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10738:x1876039893571456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1301us (2026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131319.743575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:1.0:1789131319.748474:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.748588:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571584 00000100:00100000:3.0:1789131319.748602:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571584 00000100:00100000:1.0:1789131319.748849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.748898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1789131319.748949:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:2352:x1876039893571584:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131319.748970:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789131319.748999:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571840 00010000:00010000:3.0:1789131319.749003:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904cad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039773 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.749013:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571840 00010000:00010000:3.0:1789131319.749034:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131319.749041:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131319.749059:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1789131319.749070:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10738:x1876039893571840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131319.749092:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1789131319.749113:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:2352:x1876039893571584:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 180us (661us total) trans 0 rc 0/0 00010000:00010000:0.0:1789131319.749114:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03977a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131319.749127:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00010000:00010000:0.0:1789131319.749240:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.749257:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.749987:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.750035:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.750053:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 55 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131319.750071:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7ff04b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910364928:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131319.750165:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131319.756718:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131319.757233:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7ff04b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910364928:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131319.757285:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.760441:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893571968 00000100:00100000:2.0:1789131319.760470:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893571968 00010000:00010000:2.0:1789131319.760730:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 56 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131319.760913:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1789131319.760926:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:2353:x1876039893571968:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131319.760948:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131319.760957:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 56 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.760973:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 56 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.761035:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904c83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039765 expref: 56 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.761056:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131319.761062:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.761072:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.761081:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131319.761118:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131319.761196:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:2353:x1876039893571968:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 273us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131319.761205:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:0.0:1789131319.761281:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.761297:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131319.761342:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789131319.761556:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.761574:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131319.761583:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131319.761586:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131319.761588:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15600, rc 0) 00000100:00100000:0.0:1789131319.761618:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10738:x1876039893571840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 12552us (12771us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789131319.761626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:3.0:1789131319.765208:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.766043:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572224 00000100:00100000:1.0:1789131319.766057:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572224 00000100:00100000:1.0:1789131319.766144:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1789131319.766156:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10738:x1876039893572224:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:1.0:1789131319.766175:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131319.766207:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904c1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039750 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.766232:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:1.0:1789131319.766238:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131319.766337:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893572224:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 168us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.766364:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1789131319.769519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131319.769741:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572352 00000100:00100000:1.0:1789131319.769753:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572352 00000100:00100000:1.0:1789131319.769822:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1789131319.769833:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893572352:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1789131319.769980:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.770002:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131319.770016:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131319.770269:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789131319.770385:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893572352:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 553us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131319.770394:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:1.0:1789131319.772967:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131319.773133:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572480 00000100:00100000:3.0:1789131319.773147:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572480 00000100:00100000:3.0:1789131319.773221:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:3.0:1789131319.773233:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:10738:x1876039893572480:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131319.773273:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131319.773308:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039781 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773422:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773434:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 55 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773492:0:9425:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773510:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 55 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773526:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131319.773530:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131319.773534:0:9425:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 55 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131319.773542:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f400, rc 0) 00000100:00100000:3.0:1789131319.773611:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10738:x1876039893572480:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 381us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.773619:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:2.0:1789131319.775238:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131319.775265:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910365056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131319.775392:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131319.775591:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910365056 00000100:00100000:3.0:1789131319.775600:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910365056 00000100:00100000:3.0:1789131319.775663:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789131319.775674:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1876039910365056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131319.775699:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131319.775752:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3308:x1876039910365056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131319.775760:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789131319.775872:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910365056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789131319.897759:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131320.409746:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131320.409761:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131320.409821:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789131320.409829:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131320.410002:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910365184:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789131320.410213:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131320.422552:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.422743:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572608 00000100:00100000:0.0:1789131320.422758:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572608 00000100:00100000:0.0:1789131320.422843:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:0.0:1789131320.422857:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893572608:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131320.422907:0:5844:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131320.423056:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893572608:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 201us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.423066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:3.0:1789131320.423659:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910365184:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131320.433906:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.434605:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572736 00000100:00100000:0.0:1789131320.434622:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572736 00000100:00100000:0.0:1789131320.434709:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1789131320.434722:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10739:x1876039893572736:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131320.434835:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.434860:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.434881:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440518:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440543:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440556:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440588:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440597:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440605:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131320.440650:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789131320.440655:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131320.440668:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440694:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440700:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440707:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440713:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.440717:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440726:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440738:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131320.440742:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131320.440747:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440754:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904cd7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440769:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440775:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440782:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440793:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.440796:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440802:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440810:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131320.440812:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131320.440815:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440820:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904cde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440835:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440840:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440846:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440850:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.440852:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440858:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440874:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131320.440876:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131320.440880:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.440886:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904ce5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.440982:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10739:x1876039893572736:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 6259us (7092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.440991:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1789131320.449970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.450106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893572992 00000100:00100000:1.0:1789131320.450119:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893572992 00000100:00100000:1.0:1789131320.450206:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1789131320.450218:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:10739:x1876039893572992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131320.450245:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131320.450285:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904cec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039788 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450656:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450677:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450691:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131320.450706:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789131320.450838:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450847:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450855:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450862:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131320.450868:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450877:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450891:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:1.0:1789131320.450894:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131320.450901:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450920:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450978:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904cec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039788 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.450991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:1.0:1789131320.450994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131320.450999:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6200/0x9f0de37187904cec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039788 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.451013:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:1.0:1789131320.451173:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893572992:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 956us (1220us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1789131320.451182:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:1.0:1789131320.463589:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.463732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893573120 00000100:00100000:2.0:1789131320.463746:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893573120 00000100:00100000:2.0:1789131320.463830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1789131320.463842:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893573120:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131320.463893:0:5846:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131320.464047:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893573120:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 208us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131320.464057:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1789131320.467801:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.467939:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893573376 00000100:00100000:0.0:1789131320.467952:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893573376 00000100:00100000:0.0:1789131320.468029:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:0.0:1789131320.468041:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893573376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131320.468069:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131320.468073:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131320.468107:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904c91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03976c expref: 56 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.468130:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131320.468135:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131320.468151:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904d01 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03978f expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131320.468814:0:8131:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789131320.469087:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.469124:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.469137:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.469203:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904d01 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03978f expref: 58 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.469221:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03978f expref: 57 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.469231:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131320.469234:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131320.469237:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14a00, rc 0) 00000100:00100000:0.0:1789131320.469365:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:10739:x1876039893573376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1283us (1536us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789131320.469374:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:1.0:1789131320.473374:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.473496:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893573632 00000100:00100000:2.0:1789131320.473510:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893573632 00000100:00100000:2.0:1789131320.473595:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1789131320.473609:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:10739:x1876039893573632:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131320.473718:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131320.473759:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03978f expref: 57 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.473786:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ce00) 00010000:00010000:2.0:1789131320.473800:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131320.473828:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.473845:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.473857:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478741:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478789:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478805:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478912:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478921:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478927:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478934:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.478939:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478949:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478968:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131320.478973:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131320.478978:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.478985:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479001:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479014:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479022:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479028:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.479031:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479039:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479052:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x18d819ef (ffff9c0c5855bb00) 00010000:00010000:2.0:1789131320.479055:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131320.479059:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.479065:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x18d819ef bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.479185:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893573632:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 5574us (5825us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789131320.479196:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:1.0:1789131320.490511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.490633:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893573760 00000100:00100000:0.0:1789131320.490654:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893573760 00000100:00100000:0.0:1789131320.490721:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:0.0:1789131320.490732:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:10739:x1876039893573760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131320.490754:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131320.490780:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904d24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039796 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490816:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490844:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490857:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490950:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904d24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 58 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490970:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 57 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.490980:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:0.0:1789131320.490983:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131320.490988:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:0.0:1789131320.491048:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:10739:x1876039893573760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 318us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.491055:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1789131320.494304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.494530:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574016 00000100:00100000:0.0:1789131320.494539:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574016 00000100:00100000:0.0:1789131320.494594:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1789131320.494603:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:10739:x1876039893574016:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131320.494692:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.494707:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.494736:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131320.494986:0:8131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1789131320.494994:0:8131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332468671490ns, next at 333468669459ns, rc = 0 00000004:00010000:0.0:1789131320.495072:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000049790a61 reply state 00000000773c4bca transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.495082:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131320.495201:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:10739:x1876039893574016:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 596us (906us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789131320.495209:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00010000:00010000:0.0:1789131320.498310:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498372:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498382:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498389:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.498396:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498404:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498421:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:0.0:1789131320.498425:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131320.498448:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.498463:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.499761:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.499849:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574144 00000100:00100000:1.0:1789131320.499860:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574144 00000100:00100000:1.0:1789131320.499925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1789131320.499941:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:10739:x1876039893574144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131320.499974:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131320.499996:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03979d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.500072:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.500088:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.500107:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:1.0:1789131320.500110:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131320.500114:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6c00, rc 0) 00000100:00100000:1.0:1789131320.500168:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:10739:x1876039893574144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 233us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131320.500175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:3.0:1789131320.509649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.511762:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574272 00000100:00100000:2.0:1789131320.511786:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574272 00000100:00100000:2.0:1789131320.511988:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1789131320.512025:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893574272:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789131320.512961:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893574272:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 936us (3321us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789131320.512974:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00080000:3.0:1789131320.513107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131320.519494:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.519730:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574528 00000100:00100000:0.0:1789131320.519743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574528 00000100:00100000:0.0:1789131320.519822:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1789131320.519835:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:10739:x1876039893574528:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789131320.520159:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:10739:x1876039893574528:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 324us (679us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1789131320.520169:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1789131320.527016:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.527139:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574784 00000100:00100000:0.0:1789131320.527153:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574784 00000100:00100000:0.0:1789131320.527231:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:0.0:1789131320.527245:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:10739:x1876039893574784:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789131320.527635:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:10739:x1876039893574784:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 390us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.527644:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:1.0:1789131320.536161:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.538851:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893574912 00000100:00100000:2.0:1789131320.538875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893574912 00000100:00100000:2.0:1789131320.539041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1789131320.539054:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:10739:x1876039893574912:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131320.539082:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131320.539110:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d40 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397a4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539204:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539223:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539237:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131320.539291:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131320.539315:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539369:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d40 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397a4 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539391:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397a4 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.539420:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:2.0:1789131320.539424:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131320.539429:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131320.539538:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:10739:x1876039893574912:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 486us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131320.539547:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1789131320.544064:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.546206:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575040 00000100:00100000:0.0:1789131320.546227:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575040 00000100:00100000:1.0:1789131320.546786:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1789131320.546801:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893575040:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131320.546826:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131320.546854:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397ab expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131320.546964:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3fa39, blocks: 0x1 00010000:00010000:1.0:1789131320.546993:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1789131320.546999:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131320.547011:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 10 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.547056:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 10 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.547074:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a7600, rc 0) 00000100:00100000:1.0:1789131320.547612:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893575040:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 810us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131320.547622:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1789131320.550035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.550188:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575296 00000100:00100000:3.0:1789131320.550200:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575296 00000100:00100000:3.0:1789131320.550270:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1789131320.550289:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:10739:x1876039893575296:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789131320.550446:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:10739:x1876039893575296:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 159us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.550465:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1789131320.557668:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.563754:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575424 00000100:00100000:1.0:1789131320.563768:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575424 00000100:00100000:1.0:1789131320.563839:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1789131320.563849:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:10739:x1876039893575424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131320.563867:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131320.563886:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397b2 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.563918:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.563927:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131320.563931:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131320.563937:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.563971:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 11 pid: 6704 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.564000:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 11 pid: 6704 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.564014:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910365312:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131320.564105:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131320.567607:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.567686:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575552 00000100:00100000:2.0:1789131320.567695:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575552 00010000:00010000:2.0:1789131320.567734:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 12 pid: 6704 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.567782:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1789131320.567792:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:2353:x1876039893575552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131320.567806:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131320.567830:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 12 pid: 6704 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.567843:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 12 pid: 6704 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.567867:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131320.567872:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131320.567880:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.567909:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.567946:0:8473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 12 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.567961:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910365440:192.168.203.52@tcp:105: 00000100:00100000:2.0:1789131320.568040:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5fd12e40 going to sleep for 11 seconds 00010000:00010000:3.0:1789131320.574908:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d5b2b58/0x9f0de37187904d4e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ab expref: 12 pid: 6704 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.574932:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910365312:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131320.574962:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 11 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.574978:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c414a6200, rc 0) 00000100:00100000:3.0:1789131320.575043:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:10739:x1876039893575424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 11195us (17385us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.575052:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1789131320.575856:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910365440:192.168.203.52@tcp:105: 00010000:00010000:2.0:1789131320.575873:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131320.575911:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893575552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 8120us (8314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131320.575922:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1789131320.581670:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.585622:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575680 00000100:00100000:1.0:1789131320.585635:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575680 00002000:00100000:1.0:1789131320.585700:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c0c7ff06940 x1876039893575680/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:281/0 lens 504/0 e 0 to 0 dl 1789131331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131320.585712:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7ff06940 with x1876039893575680 ext(0->12) 00002000:00010000:1.0:1789131320.585717:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7ff06940 00000100:00100000:1.0:1789131320.585746:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1789131320.585755:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893575680:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789131320.586224:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff06940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:2353:x1876039893575680:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 468us (4573us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789131320.586232:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:1.0:1789131320.586239:0:6710:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c0c7ff06940 x1876039893575680/t4294967308(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:281/0 lens 504/448 e 0 to 0 dl 1789131331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131320.586247:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7ff06940 with x1876039893575680 ext(0->12) 00002000:00010000:1.0:1789131320.586250:0:6710:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7ff06940 00000100:00100000:1.0:1789131320.590733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.591196:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575808 00000100:00100000:3.0:1789131320.591207:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575808 00000100:00100000:3.0:1789131320.591353:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1789131320.591365:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:10739:x1876039893575808:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789131320.656359:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1789131320.656377:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789131320.656421:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789131320.656438:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c452560c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789131320.656468:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c46349600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c45256780 00000020:00080000:0.0:1789131320.656473:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c46349a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0b42cc2400 00000004:00080000:0.0:1789131320.656514:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789131320.656532:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c45256b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789131320.656536:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c46349100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c45256180 00000020:00080000:0.0:1789131320.656539:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c46349e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c7a429c00 00000020:00080000:0.0:1789131320.656597:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:1.0:1789131320.656758:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10739:x1876039893575808:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 65390us (66027us total) trans 0 rc 0/0 00000020:00080000:0.0:1789131320.656766:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789131320.656772:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:0.0:1789131320.656994:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910365568:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131320.657043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131320.657121:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910365568 00000100:00100000:3.0:1789131320.657132:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910365568 00000100:00100000:3.0:1789131320.657172:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789131320.657181:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3306:x1876039910365568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789131320.657204:0:8327:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1789131320.657236:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3fa37, atime: 0x6aa3fa37, ctime: 0x6aa3fa37, blocks: 0x1 00010000:00010000:3.0:1789131320.657242:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.657257:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1789131320.657262:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131320.657267:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.657282:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.657291:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.657298:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.657316:0:8327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789131320.660353:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910365696:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789131320.660403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131320.660446:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131320.660465:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910365824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789131320.660490:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131320.660519:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910365696 00000100:00100000:2.0:1789131320.660526:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910365696 00000100:00100000:3.0:1789131320.660811:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3306:x1876039910365568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3628us (3764us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789131320.660822:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910365824 00000100:00100000:2.0:1789131320.660828:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910365824 00000100:00100000:3.0:1789131320.660838:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789131320.660852:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789131320.660863:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910365696:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789131320.660865:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789131320.660876:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1876039910365824:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:2.0:1789131320.660915:0:6706:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1789131320.660939:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.660960:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.660968:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789131320.660972:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131320.660977:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.661005:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.661021:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 11 pid: 6704 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.661033:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910365952:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131320.661093:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4374fc00 going to sleep for 11 seconds 00000100:00080000:2.0:1789131320.661107:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1789131320.661197:0:8327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789131320.661201:0:8327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789131321 00002000:00010000:3.0:1789131320.661203:0:8327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789131320.661206:0:8327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789131321 -> 1789131321 00002000:00010000:3.0:1789131320.661208:0:8327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789131320.662525:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000004:00080000:0.0:1789131320.662668:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c7437de00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789131320.662677:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910365568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789131320.664055:0:6704:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789131320.664071:0:6704:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1789131320.664102:0:6705:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1789131320.664109:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893575936 00000100:00100000:2.0:1789131320.664116:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893575936 00010000:00010000:2.0:1789131320.664424:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131320.664444:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.664465:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131320.664470:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.664482:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.664503:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.664512:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de37187904d5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.664537:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131320.664540:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131320.664541:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131320.665147:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1876039910365824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4268us (4651us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789131320.665159:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789131320.665170:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c74f09e00/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789131320.665180:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910365824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789131320.665189:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1789131320.665201:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:2353:x1876039893575936:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789131320.665662:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ad00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910365952:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131320.665683:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.669645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.669774:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576064 00000100:00100000:3.0:1789131320.669784:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576064 00010000:00010000:3.0:1789131320.669868:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 13 pid: 6704 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.669904:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1789131320.669914:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2353:x1876039893576064:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131320.669928:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131320.669934:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 13 pid: 6704 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.669962:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 13 pid: 6704 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.669987:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187904b1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039711 expref: 13 pid: 6704 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.670004:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131320.670008:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131320.670015:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.670024:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.670100:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131320.670150:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:2353:x1876039893576064:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 237us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.670159:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00010000:00010000:1.0:1789131320.670839:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.670852:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.670864:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.670873:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.670905:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131320.671311:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131320.671319:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.672507:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131320.672513:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.672525:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.673086:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.673098:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8723690/0x9f0de37187904d63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.673121:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131320.673123:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131320.673126:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131320.673377:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3307:x1876039910365696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12513us (12969us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789131320.673388:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1789131320.674402:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c74f08000/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789131320.674414:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910365696:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789131320.750547:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1789131320.750606:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1789131320.751154:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893575936:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 85951us (88629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131320.751179:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1789131320.760186:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.760285:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576320 00000100:00100000:2.0:1789131320.760295:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576320 00000100:00100000:2.0:1789131320.760388:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:2.0:1789131320.760398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10739:x1876039893576320:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131320.760460:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131320.760486:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397a4 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.760505:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:2.0:1789131320.760510:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131320.760540:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.760554:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.760581:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131320.760847:0:5846:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d8d85b17 reply state 00000000759c8776 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.760856:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131320.761085:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:10739:x1876039893576320:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 688us (908us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1789131320.761093:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00010000:00010000:1.0:1789131320.764907:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.764991:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.764999:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.765006:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131320.765011:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.765019:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.765034:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:1.0:1789131320.765037:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131320.765042:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.765048:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904d6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.771970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131320.772139:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576448 00000100:00100000:2.0:1789131320.772150:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576448 00000100:00100000:2.0:1789131320.772214:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1789131320.772224:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893576448:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131320.772462:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789131320.772467:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789131321 -> 1789131320 00002000:00010000:2.0:1789131320.772470:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789131319 00002000:00010000:2.0:1789131320.772472:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789131321 -> 1789131320 00002000:00010000:2.0:1789131320.772474:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789131320.772539:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2355:x1876039893576448:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 315us (578us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789131320.772547:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1789131320.784625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.784698:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576704 00000100:00100000:0.0:1789131320.784708:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576704 00000100:00100000:0.0:1789131320.784771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1789131320.784782:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:10739:x1876039893576704:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789131320.784863:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.784880:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 15 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.784889:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.784948:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 15 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.784962:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 15 pid: 9425 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.784976:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910366080:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131320.785067:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131320.794854:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910366080:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131320.794883:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.800961:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.801029:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576832 00000100:00100000:3.0:1789131320.801038:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576832 00010000:00010000:3.0:1789131320.801076:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 16 pid: 9425 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.801134:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1789131320.801145:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:2353:x1876039893576832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131320.801161:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131320.801168:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 16 pid: 9425 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801180:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 16 pid: 9425 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801202:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904d2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039796 expref: 16 pid: 9425 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801217:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:3.0:1789131320.801221:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801230:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801237:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.801275:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131320.801348:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:2353:x1876039893576832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 204us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.801356:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00010000:00010000:1.0:1789131320.801671:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801690:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801719:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801726:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801733:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801738:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131320.801742:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801748:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801758:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:1.0:1789131320.801760:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789131320.801763:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.801769:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904d71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.801824:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10739:x1876039893576704:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 17044us (17208us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789131320.801834:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:3.0:1789131320.804637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.804685:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893576960 00000100:00100000:3.0:1789131320.804693:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893576960 00000100:00100000:3.0:1789131320.804743:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1789131320.804752:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893576960:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789131320.804795:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.804815:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.804825:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131320.804829:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131320.804834:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.804867:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 7 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.804881:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 7 pid: 6706 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.804895:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910366208:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131320.804968:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789131320.809968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.810021:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910366208:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131320.810047:0:6706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.812167:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893577088 00000100:00100000:0.0:1789131320.812179:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893577088 00010000:00010000:0.0:1789131320.812219:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 8 pid: 6706 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.813429:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1789131320.813456:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893577088:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131320.813473:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131320.813501:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 8 pid: 6706 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.813517:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 8 pid: 6706 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.813558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444eacc9/0x9f0de37187904d55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b2 expref: 8 pid: 6706 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.813579:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131320.813584:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131320.813590:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.813601:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.813635:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131320.813700:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893577088:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 260us (3742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.813708:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00010000:00010000:2.0:1789131320.814393:0:6706:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814406:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814441:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814460:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814467:0:6706:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814475:0:6706:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131320.814479:0:6706:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814489:0:6706:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814504:0:6706:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.814512:0:6706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187904d78 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.814579:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893576960:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 9825us (9945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131320.814588:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1789131320.822689:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.822726:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893577344 00000100:00100000:1.0:1789131320.822735:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893577344 00000100:00100000:1.0:1789131320.822788:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:1.0:1789131320.822799:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10739:x1876039893577344:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131320.822886:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.822904:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.822917:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.823103:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.823115:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.823123:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.823168:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.823183:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 15 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131320.823197:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910366336:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131320.823274:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131320.829534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.829611:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893577472 00000100:00100000:3.0:1789131320.829622:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893577472 00010000:00010000:3.0:1789131320.829666:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 16 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.829708:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1789131320.829720:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:2352:x1876039893577472:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131320.829736:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131320.829743:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 16 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.829758:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 16 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.829782:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:3.0:1789131320.829788:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.829799:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.829808:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.829831:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131320.829884:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+16:2352:x1876039893577472:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 167us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.829908:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00010000:00010000:0.0:1789131320.830010:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a6c00/0x9f0de37187904d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03979d expref: 15 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.830033:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910366336:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131320.830059:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.830069:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.830077:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131320.833510:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1789131320.833734:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1789131320.833781:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1789131320.833869:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910366464:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789131320.833929:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131320.833963:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4301ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131320.834960:0:12380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910366464 00000100:00100000:1.0:1789131320.834970:0:12380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910366464 00000100:00100000:1.0:1789131320.835025:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131320.835035:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910366464:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131320.835129:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910366464:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131320.835137:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131320.835192:0:8131:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789131320.835198:0:8131:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1789131320.835214:0:8131:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c74f09e00, transno 4294967309 00000100:00100000:0.0:1789131320.835233:0:8131:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0c74f08000 x1876039910365696/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789131336 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131320.835246:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910366464:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789131320.836238:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1789131320.836737:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910366592:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789131320.836787:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131320.836861:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4367cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131320.837954:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910366592 00000100:00100000:2.0:1789131320.837964:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910366592 00000100:00100000:2.0:1789131320.838053:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131320.838064:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910366592:12345-0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789131320.838305:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1789131320.838342:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1789131320.838353:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000100:00100000:2.0:1789131320.838359:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8131:x1876039910366592:12345-0@lo:1000:mdt00_003.0 Request processed in 295us (1569us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789131320.838368:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789131320.839018:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910366592:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789131320.839057:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839067:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839075:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839081:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.839086:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839093:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839108:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ca00) 00010000:00010000:2.0:1789131320.839111:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131320.839115:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839122:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7800/0x9f0de37187904d86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839165:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839172:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839178:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839183:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.839186:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839192:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839201:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131320.839203:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131320.839210:0:8131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839221:0:8131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839230:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.839480:0:8131:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.839506:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910366720:192.168.203.52@tcp:105: 00000100:00100000:2.0:1789131320.839575:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4374f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131320.849266:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910366720:192.168.203.52@tcp:105: 00010000:00010000:0.0:1789131320.849308:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849319:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7e00/0x9f0de37187904cc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849387:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849401:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849427:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849437:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849444:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849461:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849466:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.849470:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849477:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849489:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131320.849492:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131320.849497:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849501:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d8d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849511:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849517:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849528:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849533:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414a7600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131320.849536:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849542:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849550:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131320.849552:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131320.849555:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.849560:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7600/0x9f0de37187904d7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.849773:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10739:x1876039893577344:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 26975us (27092us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1789131320.849783:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000020:00080000:0.0:1789131320.849788:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789131320.849952:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131320.849957:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131320.850495:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789131320.850506:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789131320.856272:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.856357:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893577600 00000100:00100000:0.0:1789131320.856366:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893577600 00000100:00100000:0.0:1789131320.856422:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1789131320.856431:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10738:x1876039893577600:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:0.0:1789131320.856572:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10738:x1876039893577600:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 142us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131320.856596:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:2.0:1789131320.861384:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131320.861988:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893577856 00000100:00100000:0.0:1789131320.861999:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893577856 00000100:00100000:0.0:1789131320.862058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1789131320.862069:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:10739:x1876039893577856:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789131320.864789:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789131320.864893:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1789131320.864957:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.864974:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.864987:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.864995:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.865002:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.865008:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131320.865036:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131320.865102:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131320.865111:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.865120:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131320.865124:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.865132:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.865148:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c0c4392ce00) 00000100:00100000:0.0:1789131320.865152:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10739:x1876039893577856:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 3079us (3824us total) trans 4294967408 rc 0/0 00010000:00010000:1.0:1789131320.865155:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131320.865162:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131320.865168:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00010000:00010000:1.0:1789131320.865173:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904d94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789131320.865185:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789131320.865212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131320.865215:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131320.865217:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131320.870559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.870945:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893578112 00000100:00100000:3.0:1789131320.870961:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893578112 00000100:00100000:3.0:1789131320.871053:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:3.0:1789131320.871066:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10738:x1876039893578112:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:3.0:1789131320.871491:0:9425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789131320.871621:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10738:x1876039893578112:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 557us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131320.871630:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:2.0:1789131320.910032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131320.910370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893578240 00000100:00100000:1.0:1789131320.910385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893578240 00000100:00100000:1.0:1789131320.910464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:1.0:1789131320.910477:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:10742:x1876039893578240:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131320.910503:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131320.910524:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904d9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397b9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910584:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910597:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910608:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910622:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910628:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131320.910634:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.911555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.911581:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.911591:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.911642:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.913147:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 21 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.913177:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910366848:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131320.913553:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4374fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131320.917720:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0a940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1876039910366848:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131320.918200:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131320.919280:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.919946:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893578496 00000100:00100000:3.0:1789131320.919969:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893578496 00000100:00100000:3.0:1789131320.920058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1789131320.920070:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:5589:x1876039893578496:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789131320.920795:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:5589:x1876039893578496:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 723us (1521us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789131320.920805:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00010000:00010000:3.0:1789131320.922783:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131320.928140:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131320.928884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893578624 00000100:00100000:3.0:1789131320.928899:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893578624 00010000:00010000:3.0:1789131320.929756:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 23 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.929839:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1789131320.929853:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:2352:x1876039893578624:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131320.929873:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131320.929881:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 23 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.929897:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 23 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.929926:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904cbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03977a expref: 23 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.929948:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131320.929954:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.929978:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.929987:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131320.930027:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131320.930111:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:2352:x1876039893578624:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 259us (1983us total) trans 0 rc 0/0 00010000:00010000:2.0:1789131320.930115:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131320.930124:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:2.0:1789131320.930140:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131320.930193:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789131320.930198:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131320.930221:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930238:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930249:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930256:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930264:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930271:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.930275:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930282:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930298:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131320.930318:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131320.930362:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930368:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904da2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930390:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.930396:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932509:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932517:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131320.932521:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932530:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932550:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c0c47f35600) 00010000:00010000:2.0:1789131320.932554:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131320.932558:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932565:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904da9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932622:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904d9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b9 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932659:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b9 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131320.932667:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131320.932669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131320.932672:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea400, rc 0) 00000100:00100000:2.0:1789131320.932757:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10742:x1876039893578240:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 22283us (22740us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131320.932767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1789131321.305524:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910367104:0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.305595:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131321.305650:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910367616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.305674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131321.305710:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131321.305715:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910367232:0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.305736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131321.305764:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367104 00000100:00100000:2.0:1789131321.305772:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367104 00000100:00100000:2.0:1789131321.305815:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367232 00000100:00100000:2.0:1789131321.305818:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367232 00000100:00100000:2.0:1789131321.305848:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789131321.305857:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910367104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.305905:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910367104:12345-0@lo:400:kworker.0 Request processed in 49us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131321.305913:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789131321.305940:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789131321.305946:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910367232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.305975:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910367232:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131321.305980:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789131321.305998:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367616 00000100:00100000:2.0:1789131321.306001:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367616 00000100:00100000:2.0:1789131321.306025:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789131321.306031:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910367616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.306060:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aab4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910367616:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131321.306066:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789131321.306084:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131321.306116:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910367232:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.306132:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910366976:0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.306132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910367104:0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.306143:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910367616:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.306181:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131321.306208:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910367488:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.306229:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131321.306244:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131321.306250:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910367360:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.306272:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131321.306307:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367488 00000100:00100000:3.0:1789131321.306312:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367488 00000100:00100000:2.0:1789131321.306388:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910366976 00000100:00100000:2.0:1789131321.306394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910366976 00000100:00100000:3.0:1789131321.306432:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789131321.306432:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789131321.306457:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910367488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.306459:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910366976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131321.306509:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910366976:12345-0@lo:400:kworker.0 Request processed in 66us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131321.306515:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910367488:12345-0@lo:400:kworker.0 Request processed in 72us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131321.306518:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789131321.306529:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789131321.309257:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367360 00000100:00100000:3.0:1789131321.309270:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367360 00000100:00100000:3.0:1789131321.309346:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789131321.309358:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910367360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789131321.309385:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131321.309399:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131321.309437:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910367360:12345-0@lo:400:kworker.0 Request processed in 83us (3165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131321.309504:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789131321.309549:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789131321.310077:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1789131321.310098:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c7ff04780, transno 4294967301 00000004:00080000:3.0:1789131321.310121:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789131321.310135:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c7437de00, transno 4294967304 00000100:00100000:3.0:1789131321.310145:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910367360:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.310172:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910366976:0@lo:400:kworker.0 00000100:00100000:3.0:1789131321.310187:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910367488:0@lo:400:kworker.0 00000040:00080000:0.0:1789131321.583647:0:12478:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131321.583657:0:12478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131321.583701:0:12478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789131321.583707:0:12478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131321.817732:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131321.818356:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910367744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131321.818451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131321.818501:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910367744 00000100:00100000:3.0:1789131321.818509:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910367744 00000100:00100000:3.0:1789131321.818565:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789131321.818574:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910367744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131321.818597:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789131321.818653:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910367744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131321.818660:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789131321.818805:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910367744:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1789131321.882102:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131321.882121:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131321.882180:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789131321.882188:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131321.882303:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910367872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131321.884706:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131321.893746:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131321.893865:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910367872:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789131321.896700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893578752 00000100:00100000:1.0:1789131321.896716:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893578752 00000100:00100000:1.0:1789131321.896813:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1789131321.896824:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10754:x1876039893578752:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789131321.896862:0:5845:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789131321.896966:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10754:x1876039893578752:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 144us (3229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131321.896975:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00080000:2.0:1789131321.897263:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131321.904748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131321.904928:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893579008 00000100:00100000:1.0:1789131321.904939:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893579008 00000100:00100000:1.0:1789131321.905097:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1789131321.905108:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:10754:x1876039893579008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131321.905127:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131321.905148:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904db7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397c0 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131321.905267:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131321.905281:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131321.905294:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131321.905305:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789131321.905604:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904db7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c0 expref: 24 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131321.905644:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c0 expref: 23 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131321.905653:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:1.0:1789131321.905657:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131321.905660:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fc000, rc 0) 00000100:00100000:1.0:1789131321.905727:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10754:x1876039893579008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 621us (987us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789131321.905735:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1789131321.913839:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131321.914237:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893579264 00000100:00100000:2.0:1789131321.914257:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893579264 00000100:00100000:2.0:1789131321.914318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:2.0:1789131321.914374:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10754:x1876039893579264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789131321.914462:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914480:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914490:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914710:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914718:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914723:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914729:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131321.914733:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914749:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914761:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:2.0:1789131321.914763:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131321.914768:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131321.914786:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904dcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131321.914915:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:10754:x1876039893579264:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 544us (1085us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789131321.914924:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000040:00080000:0.0:1789131321.915639:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131321.915644:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131321.916285:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789131321.916293:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789131321.917122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131321.917175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893579392 00000100:00100000:3.0:1789131321.917183:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893579392 00000100:00100000:3.0:1789131321.917234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1789131321.917249:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:2354:x1876039893579392:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131321.917264:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131321.917286:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c0 expref: 24 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131321.917361:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131321.917367:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131321.917404:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:2354:x1876039893579392:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 162us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131321.917412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1789131321.925001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131321.925134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893579648 00000100:00100000:3.0:1789131321.925144:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893579648 00000100:00100000:3.0:1789131321.925201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1789131321.925211:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:10754:x1876039893579648:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131321.925964:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:10754:x1876039893579648:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 750us (968us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789131321.925974:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00010000:00010000:2.0:1789131321.946170:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131322.969609:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131323.427400:0:12530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789131323.427408:0:12530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131323.427462:0:12530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789131323.427469:0:12530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131323.659893:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131323.659985:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893579904 00000100:00100000:3.0:1789131323.659995:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893579904 00000100:00100000:3.0:1789131323.660107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00080000:2.0:1789131323.660112:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131323.660121:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:10774:x1876039893579904:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131323.660145:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131323.660166:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904dd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397c7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131323.660453:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904dda lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131323.660468:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904dda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131323.660499:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904dda lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131323.660511:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789131323.660636:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904dd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c7 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131323.660817:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904dda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c7 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131323.660827:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:3.0:1789131323.660831:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789131323.660834:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e000, rc 0) 00000100:00100000:3.0:1789131323.660892:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:10774:x1876039893579904:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 776us (1010us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789131323.660900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1789131323.665821:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131323.666008:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580032 00000100:00100000:1.0:1789131323.666017:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580032 00000100:00100000:1.0:1789131323.666109:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:1.0:1789131323.666119:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:10774:x1876039893580032:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1789131323.666187:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666206:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666230:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666266:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666273:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666298:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666304:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131323.666308:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666316:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666352:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:1.0:1789131323.666356:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131323.666361:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131323.666369:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904de8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131323.666458:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:10774:x1876039893580032:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 339us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131323.666466:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1789131323.797614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131323.797720:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580160 00000100:00100000:2.0:1789131323.797730:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580160 00000100:00100000:2.0:1789131323.797810:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1789131323.797822:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893580160:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1789131323.797839:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131323.797860:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c522e52e/0x9f0de37187904def lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397ce expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131323.797888:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3fa38, atime: 0x6aa3fa37, ctime: 0x6aa3fa38, blocks: 0xb 00010000:00010000:2.0:1789131323.797907:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789131323.797924:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131323.797934:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c522e52e/0x9f0de37187904def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ce expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131323.797955:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c522e52e/0x9f0de37187904def lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ce expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131323.797968:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceac00, rc 0) 00000100:00100000:2.0:1789131323.798036:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2355:x1876039893580160:12345-192.168.203.52@tcp:101:cat.0 Request processed in 217us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131323.798045:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00080000:1.0:1789131323.798365:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131323.805316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131323.805644:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580288 00000100:00100000:2.0:1789131323.805655:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580288 00002000:00100000:2.0:1789131323.805703:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c0c42d8b0c0 x1876039893580288/t0(0) o3->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:284/0 lens 488/0 e 0 to 0 dl 1789131334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131323.805714:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c42d8b0c0 with x1876039893580288 ext(0->4095) 00002000:00010000:2.0:1789131323.805719:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c42d8b0c0 00000100:00100000:2.0:1789131323.805750:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1789131323.805759:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893580288:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:2.0:1789131323.806043:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893580288:12345-192.168.203.52@tcp:3:cat.0 Request processed in 285us (737us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789131323.806052:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:2.0:1789131323.806059:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c0c42d8b0c0 x1876039893580288/t0(0) o3->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:284/0 lens 488/4536 e 0 to 0 dl 1789131334 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789131323.806067:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c42d8b0c0 with x1876039893580288 ext(0->4095) 00002000:00010000:2.0:1789131323.806077:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c42d8b0c0 00010000:00010000:3.0:1789131323.993753:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131324.181090:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131324.181356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131324.181395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131324.181460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131324.181492:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580544 00000100:00100000:0.0:1789131324.181501:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580544 00000100:00100000:0.0:1789131324.181547:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580800 00000100:00100000:0.0:1789131324.181551:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580800 00000100:00100000:0.0:1789131324.181587:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1789131324.181609:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:2352:x1876039893580544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131324.181680:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:2352:x1876039893580544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 73us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131324.181688:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1789131324.181706:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1789131324.181712:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893580800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131324.181738:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893580800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131324.181744:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00080000:0.0:1789131324.181762:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131324.182184:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580672 00000100:00100000:3.0:1789131324.182189:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580672 00000100:00100000:3.0:1789131324.182235:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1789131324.182242:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893580672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131324.182291:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2352:x1876039893580672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131324.182298:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00080000:0.0:1789131324.183303:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131324.183443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580416 00000100:00100000:2.0:1789131324.183546:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580416 00000100:00100000:2.0:1789131324.183633:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:2.0:1789131324.183642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893580416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131324.183700:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893580416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 59us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131324.183706:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 315 00000100:00100000:1.0:1789131324.891082:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c4634d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910368000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131324.891181:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131324.891310:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368000 00000100:00100000:0.0:1789131324.891348:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368000 00000100:00100000:0.0:1789131324.891434:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789131324.891447:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910368000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131324.891495:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131324.891559:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910368000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131324.891567:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789131324.891735:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131324.891783:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c4634d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910368000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789131325.020018:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789131325.966468:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789131325.966490:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:2.0:1789131325.966497:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1789131325.976569:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000020:00080000:1.0:1789131325.976603:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c5094b300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789131325.976629:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c7a6a5100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c481ba540 00000020:00080000:1.0:1789131325.976633:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c7a6a5600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c7aa09800 00000020:00080000:1.0:1789131325.976663:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789131325.976674:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:1.0:1789131325.976689:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:1.0:1789131325.976703:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1789131325.976766:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1789131325.977042:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:0.0:1789131326.041996:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131326.432371:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910368128:0@lo:400:kworker.0 00000100:00100000:3.0:1789131326.432458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131326.432622:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368128 00000100:00100000:2.0:1789131326.432630:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368128 00000100:00100000:2.0:1789131326.432676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789131326.432684:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910368128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.433793:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910368256:0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.433839:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131326.433871:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131326.433878:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910368384:0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.433912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131326.433944:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910368512:0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.433970:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131326.433999:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368256 00000100:00100000:0.0:1789131326.434004:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368256 00000100:00100000:0.0:1789131326.434036:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368384 00000100:00100000:0.0:1789131326.434039:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368384 00000100:00100000:0.0:1789131326.434069:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789131326.434076:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910368256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.434119:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910368256:12345-0@lo:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131326.434125:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789131326.434144:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789131326.434149:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910368384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.434173:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910368384:12345-0@lo:400:kworker.0 Request processed in 25us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131326.434178:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789131326.434193:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368512 00000100:00100000:0.0:1789131326.434195:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368512 00000100:00100000:0.0:1789131326.434218:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789131326.434223:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910368512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.434249:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910368512:12345-0@lo:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131326.434255:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789131326.434285:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910368512:0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.434307:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910368384:0@lo:400:kworker.0 00000100:00100000:0.0:1789131326.434345:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910368256:0@lo:400:kworker.0 00000100:00080000:1.0:1789131326.437993:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131326.438004:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131326.438012:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131326.438031:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910368640:0@lo:400:kworker.0 00000100:00100000:1.0:1789131326.438111:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131326.438152:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910368768:0@lo:400:kworker.0 00000100:00100000:1.0:1789131326.438181:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131326.438231:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368640 00000100:00100000:1.0:1789131326.438238:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368640 00000100:00100000:1.0:1789131326.438290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789131326.438299:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910368640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131326.438363:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910368640:12345-0@lo:400:kworker.0 Request processed in 65us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131326.438372:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1789131326.438391:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131326.438429:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910368640:0@lo:400:kworker.0 00000100:00100000:2.0:1789131326.441168:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910368128:12345-0@lo:400:kworker.0 Request processed in 8478us (8704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131326.441181:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789131326.441380:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368768 00000100:00100000:2.0:1789131326.441388:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368768 00000100:00100000:2.0:1789131326.441450:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789131326.441460:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910368768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131326.441525:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910368768:12345-0@lo:400:kworker.0 Request processed in 68us (3344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131326.441531:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1789131326.441546:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131326.441576:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1789131326.441595:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c74f08000, transno 4294967310 00000004:00080000:2.0:1789131326.441606:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1789131326.441628:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910368768:0@lo:400:kworker.0 00000100:00100000:3.0:1789131326.443015:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910368128:0@lo:400:kworker.0 00000100:00100000:2.0:1789131326.940009:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131326.940032:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910368896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131326.940098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131326.942440:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910368896 00000100:00100000:2.0:1789131326.942454:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910368896 00000100:00100000:2.0:1789131326.942521:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789131326.942532:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910368896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131326.942571:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131326.942643:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910368896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (2544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131326.942650:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789131326.943464:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910368896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789131327.067068:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131328.091303:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131328.709924:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131328.710012:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893580928 00000100:00100000:2.0:1789131328.710022:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893580928 00000100:00100000:2.0:1789131328.710101:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1789131328.710112:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10427:x1876039893580928:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789131328.710232:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10427:x1876039893580928:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 122us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131328.710245:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00080000:1.0:1789131328.710983:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131328.716228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131328.716533:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581184 00000100:00100000:0.0:1789131328.716543:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581184 00000100:00100000:0.0:1789131328.724556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1789131328.724596:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:10427:x1876039893581184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789131328.725129:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:10427:x1876039893581184:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 550us (8923us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789131328.728508:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00010000:00010000:0.0:1789131329.113528:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131329.114453:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131329.114459:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131329.114741:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789131329.114748:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131329.282479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131329.282692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581312 00000100:00100000:2.0:1789131329.282702:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581312 00000100:00100000:2.0:1789131329.282769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:2.0:1789131329.282779:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893581312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131329.282919:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893581312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 139us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131329.282942:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 317 00000100:00100000:0.0:1789131329.282981:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131329.283031:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581568 00000100:00100000:1.0:1789131329.283036:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581568 00000100:00100000:1.0:1789131329.283093:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:1.0:1789131329.283102:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893581568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131329.283143:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893581568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131329.283151:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00080000:2.0:1789131329.283205:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131329.285192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131329.285235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131329.285277:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131329.285306:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131329.285373:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581824 00000100:00100000:3.0:1789131329.285382:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581824 00000100:00100000:3.0:1789131329.285592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581440 00000100:00100000:3.0:1789131329.285596:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581440 00000100:00100000:3.0:1789131329.285620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581952 00000100:00100000:3.0:1789131329.285623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581952 00000100:00100000:3.0:1789131329.285639:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:3.0:1789131329.285648:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2354:x1876039893581824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131329.285710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2354:x1876039893581824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 63us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131329.285717:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:3.0:1789131329.285745:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1789131329.285752:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2354:x1876039893581440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131329.285788:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2354:x1876039893581440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131329.285795:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1789131329.285808:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:3.0:1789131329.285813:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:11229:x1876039893581952:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:3.0:1789131329.285824:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131329.285844:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397d5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.285903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.285917:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.285928:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131329.286109:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1789131329.286113:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131329.286206:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.286230:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.286247:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131329.286267:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:3.0:1789131329.286271:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789131329.286275:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e200, rc 0) 00000100:00100000:3.0:1789131329.286298:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+6:11229:x1876039893581952:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 485us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131329.286305:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:2.0:1789131329.287229:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893581696 00000100:00100000:2.0:1789131329.287240:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893581696 00000100:00100000:2.0:1789131329.287289:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1789131329.287298:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893581696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131329.287367:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2354:x1876039893581696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131329.287374:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00080000:2.0:1789131329.287409:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131329.287414:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131330.009762:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910369024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131330.009839:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131330.009969:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369024 00000100:00100000:1.0:1789131330.009977:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369024 00000100:00080000:2.0:1789131330.010024:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131330.010034:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789131330.010044:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910369024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131330.010076:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131330.010114:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910369024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131330.010121:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789131330.010416:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910369024:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789131330.137661:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789131331.120948:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789131331.120965:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789131331.121037:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789131331.121047:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789131331.164164:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131331.545714:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131331.545738:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910369152:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.545768:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910369408:0@lo:400:kworker.0 00000100:00100000:3.0:1789131331.545831:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910369664:0@lo:400:kworker.0 00000100:00100000:0.0:1789131331.545840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910369280:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.545918:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131331.545987:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369408 00000100:00100000:1.0:1789131331.545992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131331.545996:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369408 00000100:00100000:1.0:1789131331.546031:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910369536:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.546055:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789131331.546065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131331.546070:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910369408:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789131331.546114:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131331.546130:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910369408:12345-0@lo:400:kworker.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131331.546130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369152 00000100:00100000:1.0:1789131331.546136:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369152 00000100:00100000:2.0:1789131331.546143:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789131331.546171:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:1.0:1789131331.546180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910369152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.546194:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910369408:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.546229:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369536 00000100:00100000:2.0:1789131331.546232:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369536 00000100:00100000:1.0:1789131331.546243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c430ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910369152:12345-0@lo:400:kworker.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131331.546251:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789131331.546262:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789131331.546272:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910369536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131331.546344:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910369152:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.546353:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910369536:12345-0@lo:400:kworker.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131331.546361:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789131331.546367:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910369536:0@lo:400:kworker.0 00000100:00100000:3.0:1789131331.549949:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131331.550040:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369664 00000100:00100000:2.0:1789131331.550049:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369664 00000100:00100000:2.0:1789131331.550114:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789131331.550124:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910369664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789131331.550136:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131331.550187:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910369664:12345-0@lo:400:kworker.0 Request processed in 65us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131331.550193:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910369664:0@lo:400:kworker.0 00000100:00100000:2.0:1789131331.550194:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789131331.552527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131331.552581:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910369792:0@lo:400:kworker.0 00000100:00100000:0.0:1789131331.552615:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131331.552993:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369280 00000100:00100000:3.0:1789131331.553068:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369280 00000100:00100000:1.0:1789131331.553187:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369792 00000100:00100000:1.0:1789131331.553192:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369792 00000100:00100000:1.0:1789131331.553246:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789131331.553257:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910369792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131331.553317:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910369792:12345-0@lo:400:kworker.0 Request processed in 62us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131331.553351:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789131331.553406:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910369792:0@lo:400:kworker.0 00000100:00080000:0.0:1789131331.554471:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131331.556176:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789131331.556199:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910369280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131331.556303:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910369280:12345-0@lo:400:kworker.0 Request processed in 116us (3781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131331.556311:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789131331.559995:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74f0e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910369280:0@lo:400:kworker.0 00000100:00100000:2.0:1789131332.062230:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910369920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131332.062312:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131332.062612:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910369920 00000100:00100000:3.0:1789131332.062619:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910369920 00000100:00100000:3.0:1789131332.062670:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131332.062692:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910369920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131332.062732:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131332.062785:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910369920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131332.062792:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789131332.062976:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910369920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789131332.185476:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131333.118721:0:12731:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 08:55:32 (1789131332) 00010000:00010000:3.0:1789131333.211926:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131334.233550:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131334.401894:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131334.401944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131334.401977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131334.401999:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582336 00000100:00100000:2.0:1789131334.402007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131334.402008:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582336 00000100:00100000:2.0:1789131334.402045:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131334.402063:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582464 00000100:00100000:3.0:1789131334.402066:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582464 00000100:00100000:2.0:1789131334.402068:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1789131334.402078:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893582336:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131334.402086:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1789131334.402091:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893582464:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131334.402144:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2355:x1876039893582464:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 52us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131334.402152:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00080000:3.0:1789131334.402171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789131334.402175:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131334.402316:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582592 00000100:00100000:1.0:1789131334.402349:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582592 00000100:00100000:1.0:1789131334.402395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582208 00000100:00100000:1.0:1789131334.402399:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582208 00000100:00100000:1.0:1789131334.402421:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1789131334.402427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2355:x1876039893582592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131334.403076:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582080 00000100:00100000:0.0:1789131334.403083:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582080 00000100:00100000:0.0:1789131334.403127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:0.0:1789131334.403210:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893582080:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131334.403442:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2355:x1876039893582336:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1363us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131334.403451:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1789131334.403484:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1789131334.403493:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2355:x1876039893582208:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131334.403528:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2355:x1876039893582208:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131334.403535:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00080000:2.0:1789131334.403573:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131334.412748:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2355:x1876039893582592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 10311us (10760us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131334.412763:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:0.0:1789131334.413315:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2355:x1876039893582080:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 10176us (11426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131334.413342:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 319 00000100:00100000:2.0:1789131334.429847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131334.430052:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582848 00000100:00100000:3.0:1789131334.430063:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582848 00000100:00100000:3.0:1789131334.430123:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:3.0:1789131334.430133:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:11494:x1876039893582848:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131334.430154:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131334.430176:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e04 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397dc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430258:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430285:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430296:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430469:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430479:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.430487:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.431948:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e19 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.432695:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.432708:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e19 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131334.432721:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1789131334.433967:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.433981:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.433987:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434003:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131334.434008:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434016:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434031:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c431fac00) 00010000:00010000:3.0:1789131334.434034:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131334.434039:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434057:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434063:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434069:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434074:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131334.434077:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434082:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434100:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0c431fa300) 00010000:00010000:3.0:1789131334.434102:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131334.434106:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434111:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e12 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434609:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e04 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397dc expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434625:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e19 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397dc expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.434633:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:3.0:1789131334.434635:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131334.434637:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f600, rc 0) 00000100:00100000:3.0:1789131334.434714:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:11494:x1876039893582848:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4582us (4875us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789131334.434723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1789131334.445868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131334.445932:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131334.445985:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893582976 00000100:00100000:1.0:1789131334.445999:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893582976 00000100:00100000:1.0:1789131334.446086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:1.0:1789131334.446098:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:11494:x1876039893582976:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789131334.446423:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:11494:x1876039893582976:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 326us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131334.446432:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1789131334.452476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583104 00000100:00100000:3.0:1789131334.452616:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583104 00000100:00100000:3.0:1789131334.452972:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131334.452985:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:2352:x1876039893583104:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131334.453006:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131334.453039:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e19 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397dc expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131334.453084:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:3.0:1789131334.453090:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131334.453188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2352:x1876039893583104:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 206us (7254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131334.454645:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131335.130538:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131335.130561:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910370048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131335.130708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131335.130804:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910370048 00000100:00100000:3.0:1789131335.130812:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910370048 00000100:00100000:3.0:1789131335.130870:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789131335.130880:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910370048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131335.130913:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131335.130959:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74068450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910370048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131335.130965:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1789131335.131230:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131335.131293:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910370048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789131335.258793:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131335.261136:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131335.261149:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131335.261196:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1789131335.261205:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789131336.206280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131336.206358:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583232 00000100:00100000:1.0:1789131336.206367:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583232 00000100:00100000:1.0:1789131336.206779:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1789131336.206793:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11537:x1876039893583232:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131336.206814:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131336.206836:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397e3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206901:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206916:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206929:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206945:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206953:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.206960:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207737:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207748:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207754:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207761:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131336.207765:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207772:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207787:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:1.0:1789131336.207791:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131336.207796:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207802:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc800/0x9f0de37187904e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207814:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207820:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207826:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207837:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131336.207840:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207845:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207853:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0c47f35100) 00010000:00010000:1.0:1789131336.207856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131336.207859:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.207865:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fc000/0x9f0de37187904e35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789131336.208862:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131336.209844:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904e27 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397e3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.209864:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:1.0:1789131336.209868:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131336.209875:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c413fda00/0x9f0de37187904e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397e3 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.209890:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c413fda00, rc 0) 00000100:00100000:1.0:1789131336.210010:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11537:x1876039893583232:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3219us (3739us total) trans 0 rc 301/301 00000100:00100000:1.0:1789131336.210019:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:1.0:1789131336.217975:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131336.218029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583488 00000100:00100000:1.0:1789131336.218040:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583488 00000100:00100000:1.0:1789131336.218735:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:1.0:1789131336.218751:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11537:x1876039893583488:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1789131336.219016:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131336.219045:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879047a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03961c expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.219063:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:1.0:1789131336.219069:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131336.219685:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.219703:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.219712:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.219746:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.219885:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 5 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131336.219903:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c772c5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910370176:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131336.220010:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74d70540 going to sleep for 11 seconds 00000001:00080000:0.0:1789131336.221908:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:1.0:1789131336.237486:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.237534:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583616 00000100:00100000:2.0:1789131336.237543:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583616 00000100:00080000:1.0:1789131336.237600:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789131336.237615:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 6 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.237653:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1789131336.237663:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2352:x1876039893583616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789131336.237666:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c772c5e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910370176:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131336.237680:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131336.237689:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 6 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.237692:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237709:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 6 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237735:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187904dfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397d5 expref: 6 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237760:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:2.0:1789131336.237766:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237840:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237905:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.237936:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131336.237955:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.237965:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.237991:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2352:x1876039893583616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 329us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.238000:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00010000:00010000:3.0:1789131336.238383:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.238395:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.238403:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131336.241165:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789131336.241181:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241192:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241200:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241206:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131336.241210:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241216:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241232:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c4392cf00) 00010000:00010000:3.0:1789131336.241235:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131336.241239:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.241255:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187904e3c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131336.241275:0:5846:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001b187ad8 reply state 00000000c0d70caa transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131336.241283:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131336.241544:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11537:x1876039893583488:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 22793us (23574us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789131336.241554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00010000:00010000:0.0:1789131336.249634:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249651:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249660:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249667:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131336.249672:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249681:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249699:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0c431faa00) 00010000:00010000:0.0:1789131336.249702:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131336.249706:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.249713:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187904e43 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.282031:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131336.343257:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.343378:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583744 00000100:00100000:2.0:1789131336.343388:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583744 00000100:00100000:2.0:1789131336.343447:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:2.0:1789131336.343458:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:11545:x1876039893583744:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1789131336.343483:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.343504:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397ea expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343570:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343584:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343595:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131336.343667:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131336.343672:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131336.343698:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343723:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ea expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343740:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ea expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.343749:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:2.0:1789131336.343753:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131336.343757:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cebe00, rc 0) 00000100:00100000:2.0:1789131336.343817:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11545:x1876039893583744:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 361us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.343826:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1789131336.405473:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.405587:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893583872 00000100:00100000:2.0:1789131336.405596:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893583872 00000100:00100000:2.0:1789131336.405655:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:2.0:1789131336.405665:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:11551:x1876039893583872:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131336.405684:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.405705:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904e58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397f1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405765:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405796:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405808:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405824:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405837:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405953:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405961:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.405969:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131336.405997:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1789131336.406001:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131336.406024:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406037:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406053:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406060:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406066:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceba00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131336.406071:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406078:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406089:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:2.0:1789131336.406093:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131336.406097:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406103:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceba00/0x9f0de37187904e5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406118:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406124:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406130:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406135:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131336.406144:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406151:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406159:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c0c5855b100) 00010000:00010000:2.0:1789131336.406162:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131336.406165:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406171:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb400/0x9f0de37187904e66 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406201:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea800/0x9f0de37187904e58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f1 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406213:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f1 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.406220:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:2.0:1789131336.406223:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789131336.406225:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb000, rc 0) 00000100:00100000:2.0:1789131336.406295:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:11551:x1876039893583872:12345-192.168.203.52@tcp:101:bash.0 Request processed in 631us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.406303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:1.0:1789131336.409426:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.409555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893584128 00000100:00100000:3.0:1789131336.409571:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893584128 00000100:00100000:3.0:1789131336.409642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:3.0:1789131336.409653:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+15:11551:x1876039893584128:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1789131336.409679:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131336.409708:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397f8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.409889:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.409907:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.409919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.411446:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.411483:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.411496:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789131336.412103:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1789131336.412270:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.412280:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.412290:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413028:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413038:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413045:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413052:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131336.413056:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413064:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413090:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131336.413093:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131336.413098:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413104:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904e7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131336.413117:0:5846:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d37c3748 reply state 00000000ebe2599d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131336.413125:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789131336.413163:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904e74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413176:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.413192:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:3.0:1789131336.413195:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131336.413198:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f800, rc 0) 00000100:00100000:3.0:1789131336.415499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11551:x1876039893584128:12345-192.168.203.52@tcp:101:bash.0 Request processed in 5835us (6071us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1789131336.415635:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00010000:00010000:1.0:1789131336.420038:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420057:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420064:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420070:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131336.420074:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420081:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420107:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c431fa600) 00010000:00010000:1.0:1789131336.420110:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131336.420115:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.420122:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de37187904e82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131336.422734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.422862:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893584256 00000100:00100000:2.0:1789131336.422873:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893584256 00000100:00100000:2.0:1789131336.422951:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1789131336.422960:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893584256:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131336.422990:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.423010:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0397ff expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131336.423034:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789131336.423051:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789131336.423056:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00080000:1.0:1789131336.423061:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131336.423066:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.423084:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 6 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.423097:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea800, rc 0) 00000100:00100000:2.0:1789131336.423148:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2353:x1876039893584256:12345-192.168.203.52@tcp:101:bash.0 Request processed in 189us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.423155:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1789131336.427880:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.427987:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893584384 00000100:00100000:2.0:1789131336.427997:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893584384 00000100:00100000:2.0:1789131336.428059:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1789131336.428068:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:11551:x1876039893584384:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131336.428085:0:8327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.428102:0:8327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039806 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.428132:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.428155:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131336.428160:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131336.428166:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 7 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.428198:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.428211:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.428235:0:8327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910370304:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131336.428356:0:8327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789131336.436952:0:8327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60d680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910370304:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131336.436986:0:8327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 7 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.437005:0:8327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb400, rc 0) 00000100:00100000:2.0:1789131336.437057:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:11551:x1876039893584384:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8990us (9186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.437066:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131336.437319:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.438053:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893584512 00000100:00100000:3.0:1789131336.438061:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893584512 00010000:00010000:3.0:1789131336.438098:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131336.438153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1789131336.438169:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893584512:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131336.438183:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131336.438207:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.438394:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.438419:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003910b96d/0x9f0de37187904e97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ff expref: 7 pid: 6706 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.438435:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131336.438439:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131336.438448:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.438459:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.438496:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131336.438511:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910370432:192.168.203.52@tcp:105: 00000100:00100000:3.0:1789131336.438582:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131336.444785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131336.445456:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893584768 00000100:00100000:1.0:1789131336.445466:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893584768 00000100:00100000:1.0:1789131336.445559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1789131336.445569:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:11551:x1876039893584768:12345-192.168.203.52@tcp:35:bash.0 00000001:00080000:1.0:1789131336.445817:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:1.0:1789131336.445934:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11551:x1876039893584768:12345-192.168.203.52@tcp:35:bash.0 Request processed in 365us (1159us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789131336.445941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000020:00080000:1.0:1789131336.445946:0:5848:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131336.446458:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910370432:192.168.203.52@tcp:105: 00010000:00010000:0.0:1789131336.446480:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131336.446510:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893584512:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 8349us (9191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131336.446518:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1789131336.556176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131336.556381:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893585024 00000100:00100000:0.0:1789131336.556391:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893585024 00000100:00100000:0.0:1789131336.556461:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1789131336.556470:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11561:x1876039893585024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131336.556494:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131336.556513:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904ea5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03980d expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131336.556619:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1789131336.556735:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904ea5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03980d expref: 21 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.556749:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:0.0:1789131336.556753:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131336.556758:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904ea5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03980d expref: 21 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.556771:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131336.556835:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11561:x1876039893585024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 366us (669us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1789131336.556842:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:2.0:1789131336.559371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.559624:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893585280 00000100:00100000:3.0:1789131336.559633:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893585280 00000100:00100000:3.0:1789131336.559690:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1789131336.559702:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11561:x1876039893585280:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1789131336.559989:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:11561:x1876039893585280:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 289us (668us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1789131336.559998:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1789131336.666301:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910370560:0@lo:400:kworker.0 00000100:00100000:3.0:1789131336.666414:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131336.666460:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910371072:0@lo:400:kworker.0 00000100:00100000:3.0:1789131336.666485:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131336.666511:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131336.666516:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910370944:0@lo:400:kworker.0 00000100:00100000:3.0:1789131336.666541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131336.666571:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910371072 00000100:00100000:3.0:1789131336.666578:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910371072 00000100:00100000:3.0:1789131336.666629:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789131336.666639:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910371072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131336.666691:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910371072:12345-0@lo:400:kworker.0 Request processed in 54us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131336.666699:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789131336.666721:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131336.666749:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910371072:0@lo:400:kworker.0 00000100:00100000:0.0:1789131336.666839:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910370560 00000100:00100000:0.0:1789131336.666850:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910370560 00000100:00100000:0.0:1789131336.666891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789131336.666899:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910370560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131336.666949:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910370560:12345-0@lo:400:kworker.0 Request processed in 51us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131336.666956:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789131336.666991:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910370560:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667285:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910370688:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131336.667383:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910371200:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131336.667426:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131336.667433:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910370816:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667454:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131336.667484:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910370944 00000100:00100000:2.0:1789131336.667487:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910370944 00000100:00100000:2.0:1789131336.667514:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910371200 00000100:00100000:2.0:1789131336.667518:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910371200 00000100:00100000:2.0:1789131336.667542:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789131336.667548:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910370944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667586:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910370944:12345-0@lo:400:kworker.0 Request processed in 38us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.667592:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789131336.667606:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789131336.667612:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910371200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667642:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910371200:12345-0@lo:400:kworker.0 Request processed in 30us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.667648:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1789131336.667666:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131336.667684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910371200:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667709:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910370688 00000100:00100000:2.0:1789131336.667712:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910370688 00000100:00100000:2.0:1789131336.667735:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910370816 00000100:00100000:2.0:1789131336.667738:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910370816 00000100:00100000:2.0:1789131336.667775:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789131336.667789:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910370688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667827:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910370688:12345-0@lo:400:kworker.0 Request processed in 41us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.667833:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789131336.667844:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789131336.667849:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910370816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667874:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910370816:12345-0@lo:400:kworker.0 Request processed in 24us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.667879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:2.0:1789131336.667892:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131336.667910:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910370816:0@lo:400:kworker.0 00000100:00100000:2.0:1789131336.667920:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910370688:0@lo:400:kworker.0 00000100:00100000:0.0:1789131336.668683:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910370944:0@lo:400:kworker.0 00000100:00100000:1.0:1789131336.675945:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.676042:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893585408 00000100:00100000:2.0:1789131336.676051:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893585408 00000100:00100000:2.0:1789131336.676116:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:2.0:1789131336.676126:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:11567:x1876039893585408:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131336.676150:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.676386:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904eb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039814 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676459:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676473:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676484:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131336.676560:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1789131336.676565:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131336.676591:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676620:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904eb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039814 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676637:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039814 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.676646:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:2.0:1789131336.676649:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131336.676652:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1800, rc 0) 00000100:00100000:2.0:1789131336.676751:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:11567:x1876039893585408:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 626us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.676768:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:0.0:1789131336.682410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.682942:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893585664 00000100:00100000:2.0:1789131336.682952:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893585664 00000100:00100000:2.0:1789131336.683013:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:2.0:1789131336.683029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:11567:x1876039893585664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131336.683051:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.683072:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ec1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03981b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.683167:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ec8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.685411:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.685425:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ec8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131336.685457:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789131336.685611:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ec1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03981b expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.685633:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ec8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03981b expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.685642:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:2.0:1789131336.685645:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131336.685649:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0e00, rc 0) 00000100:00100000:2.0:1789131336.685725:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11567:x1876039893585664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2698us (3323us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789131336.685734:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:2.0:1789131336.691388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131336.692060:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893585920 00000100:00100000:0.0:1789131336.692072:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893585920 00000100:00100000:0.0:1789131336.692193:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:0.0:1789131336.692203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11567:x1876039893585920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131336.692228:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131336.692249:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904ed6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039822 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.692388:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.692409:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.692421:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131336.692681:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789131336.692996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904ed6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039822 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.693030:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039822 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.693041:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:0.0:1789131336.693045:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131336.693048:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15600, rc 0) 00000100:00100000:0.0:1789131336.693121:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11567:x1876039893585920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 919us (1742us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789131336.693129:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:1.0:1789131336.699530:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.699670:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586048 00000100:00100000:2.0:1789131336.699680:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586048 00000100:00100000:2.0:1789131336.699749:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1789131336.699771:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:2354:x1876039893586048:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131336.699787:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131336.699812:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ec8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03981b expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.699847:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:2.0:1789131336.699853:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131336.699922:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:2354:x1876039893586048:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 163us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.699930:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131336.702949:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.703289:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586176 00000100:00100000:2.0:1789131336.703298:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586176 00000100:00100000:2.0:1789131336.703386:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1789131336.703397:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893586176:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:2.0:1789131336.703447:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.703467:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.703475:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131336.703480:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131336.703485:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.703537:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.703552:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 6 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.703593:0:8327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910371328:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131336.703675:0:8327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131336.706963:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.707065:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586304 00000100:00100000:3.0:1789131336.707074:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586304 00002000:00100000:3.0:1789131336.707130:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c0c742cd680 x1876039893586304/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:297/0 lens 504/0 e 0 to 0 dl 1789131347 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131336.707152:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742cd680 with x1876039893586304 ext(0->12) 00010000:00010000:3.0:1789131336.707264:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 7 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.707283:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 7 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131336.707292:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742cd680 00000100:00100000:3.0:1789131336.707367:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1789131336.707377:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893586304:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:3.0:1789131336.707944:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893586304:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 567us (988us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789131336.707953:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:3.0:1789131336.707961:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c0c742cd680 x1876039893586304/t4294967305(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:297/0 lens 504/448 e 0 to 0 dl 1789131347 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131336.707970:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c742cd680 with x1876039893586304 ext(0->12) 00010000:00010000:3.0:1789131336.707977:0:6711:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.707989:0:6711:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131336.708006:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c742cd680 00000100:00100000:2.0:1789131336.708110:0:8327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910371328:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131336.708134:0:8327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131336.712740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131336.712876:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586432 00000100:00100000:0.0:1789131336.712885:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586432 00010000:00010000:0.0:1789131336.712939:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131336.712984:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1789131336.712994:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893586432:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131336.713010:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789131336.713027:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789131336.713030:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789131337 00002000:00010000:0.0:1789131336.713032:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789131337 00002000:00010000:0.0:1789131336.713034:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789131337 00010000:00010000:0.0:1789131336.713040:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.713054:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.713094:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8723690/0x9f0de37187904e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039806 expref: 9 pid: 8327 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.713112:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131336.713117:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131336.713122:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.713132:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.713173:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131336.713233:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893586432:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 240us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131336.713242:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:2.0:1789131336.713607:0:8327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713618:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713642:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713650:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713657:0:8327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713664:0:8327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131336.713668:0:8327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713691:0:8327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713703:0:8327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.713711:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076c2aaae/0x9f0de37187904eeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.713775:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893586176:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 10379us (10835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.713783:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1789131336.720862:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.721055:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586688 00000100:00100000:3.0:1789131336.721065:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586688 00000100:00100000:3.0:1789131336.721118:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1789131336.721129:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:11567:x1876039893586688:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1789131336.721396:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039822 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131336.721865:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789131336.722789:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789131336.724121:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1789131336.724635:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.724657:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.724667:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.724705:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.724722:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 29 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.724747:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910371456:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131336.724899:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131336.731151:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.731950:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1876039910371456:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131336.731980:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131336.732562:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586816 00000100:00100000:1.0:1789131336.732571:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586816 00010000:00010000:1.0:1789131336.732614:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 30 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131336.732805:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1789131336.732817:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+30:2353:x1876039893586816:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131336.732833:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131336.732842:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 30 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732855:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 30 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732897:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187904e89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f8 expref: 30 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732913:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:1.0:1789131336.732918:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732927:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732934:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131336.732964:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131336.733550:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:2353:x1876039893586816:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 222us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131336.733561:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00010000:00010000:2.0:1789131336.733626:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.733635:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131336.733760:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1789131336.733950:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789131336.734077:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910371584:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131336.734152:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131336.734794:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4367cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131336.734874:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910371584 00000100:00100000:0.0:1789131336.734881:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910371584 00000100:00100000:0.0:1789131336.734929:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131336.734938:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876039910371584:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789131336.735012:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1876039910371584:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131336.735019:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131336.735501:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910371584:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131336.735949:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789131336.736032:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910371712:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789131336.736082:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131336.736115:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131336.736752:0:12380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910371712 00000100:00100000:0.0:1789131336.736759:0:12380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910371712 00000100:00100000:0.0:1789131336.736811:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789131336.736820:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:5847:x1876039910371712:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789131336.736981:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5847:x1876039910371712:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 162us (898us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789131336.736988:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131336.738705:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1876039910371712:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789131336.738789:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789131336.738838:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738858:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738866:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131336.738876:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738884:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738899:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:2.0:1789131336.738902:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789131336.738907:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.738913:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904ef2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789131336.739804:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789131336.739964:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789131336.739976:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348713653442ns, next at 349713651128ns, rc = 0 00000001:00080000:2.0:1789131336.740765:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789131336.740835:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c431fa700) 00010000:00010000:2.0:1789131336.740840:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789131336.740851:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904edd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039822 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.741060:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11567:x1876039893586688:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 19932us (20206us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789131336.741070:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000020:00080000:2.0:1789131336.741083:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789131336.746303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.748551:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893586944 00000100:00100000:2.0:1789131336.748565:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893586944 00000100:00100000:2.0:1789131336.748636:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:2.0:1789131336.748645:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11567:x1876039893586944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131336.748670:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.748692:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ef9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039829 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.748746:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039829 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.748759:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039829 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.748777:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:2.0:1789131336.748780:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131336.748783:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0e00, rc 0) 00000100:00100000:2.0:1789131336.748847:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:11567:x1876039893586944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 203us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.748854:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1789131336.756068:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131336.756270:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893587200 00000100:00100000:1.0:1789131336.756280:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893587200 00000100:00100000:1.0:1789131336.756369:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1789131336.756380:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+33:11567:x1876039893587200:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131336.756603:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11567:x1876039893587200:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 225us (545us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789131336.758523:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1789131336.886402:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.886503:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893587456 00000100:00100000:2.0:1789131336.886513:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893587456 00000100:00100000:2.0:1789131336.886588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1789131336.886599:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11577:x1876039893587456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131336.886623:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131336.886643:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039830 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131336.886753:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1789131336.886867:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039830 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.886881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:2.0:1789131336.886884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131336.886889:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039830 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.886903:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1600, rc 0) 00000100:00100000:2.0:1789131336.886966:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11577:x1876039893587456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 369us (572us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1789131336.886974:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:0.0:1789131336.895428:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131336.895601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893587584 00000100:00100000:3.0:1789131336.895611:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893587584 00000100:00100000:3.0:1789131336.895667:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:3.0:1789131336.895676:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11577:x1876039893587584:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1789131336.895746:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895763:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895774:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895790:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895797:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895816:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895910:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895919:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895926:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789131336.895966:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895979:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895986:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895993:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.895999:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131336.896003:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896011:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896022:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131336.896031:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131336.896038:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896043:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896057:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896063:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896069:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896073:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131336.896076:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896082:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896089:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c431fa900) 00010000:00010000:3.0:1789131336.896092:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131336.896094:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896099:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896113:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896125:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896130:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896149:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131336.896152:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896816:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896827:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:3.0:1789131336.896830:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131336.896834:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131336.896839:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131336.896932:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11577:x1876039893587584:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1254us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131336.896941:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:0.0:1789131336.900211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131336.900311:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893587840 00000100:00100000:1.0:1789131336.900359:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893587840 00000100:00100000:1.0:1789131336.900420:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1789131336.900445:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11577:x1876039893587840:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131336.900910:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:11577:x1876039893587840:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 466us (706us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789131336.900919:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1789131336.966761:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131336.966935:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893588096 00000100:00100000:0.0:1789131336.966944:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893588096 00000100:00100000:0.0:1789131336.967006:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:0.0:1789131336.967016:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:11580:x1876039893588096:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131336.967041:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131336.967059:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039837 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967126:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967140:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967151:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967164:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967171:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967190:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967309:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967317:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967370:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131336.967380:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789131336.967467:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967474:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967480:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967486:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131336.967490:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967497:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967518:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131336.967521:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131336.967535:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967541:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967555:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967562:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967568:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967573:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131336.967576:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967580:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967587:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392c900) 00010000:00010000:0.0:1789131336.967589:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131336.967592:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967597:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967634:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 39 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967671:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 38 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131336.967679:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131336.967681:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131336.967684:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14400, rc 0) 00000100:00100000:0.0:1789131336.967737:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11580:x1876039893588096:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 723us (987us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789131336.967745:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:0.0:1789131336.982950:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131336.983038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893588224 00000100:00100000:2.0:1789131336.983048:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893588224 00000100:00100000:2.0:1789131336.983107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:2.0:1789131336.983116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11580:x1876039893588224:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1789131336.983178:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983194:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983219:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983243:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983250:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983258:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983264:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131336.983268:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983276:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983288:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:2.0:1789131336.983291:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131336.983296:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131336.983302:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1600/0x9f0de37187904f46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131336.983426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11580:x1876039893588224:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 310us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131336.983434:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1789131336.990696:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131336.990790:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893588480 00000100:00100000:0.0:1789131336.990804:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893588480 00000100:00100000:0.0:1789131336.990896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1789131336.990907:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11580:x1876039893588480:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131336.991164:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:11580:x1876039893588480:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 258us (476us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789131336.991172:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1789131337.177984:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910371840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131337.178070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131337.178260:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910371840 00000100:00100000:3.0:1789131337.178268:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910371840 00000100:00100000:3.0:1789131337.178377:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789131337.178387:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910371840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131337.178422:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131337.182791:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910371840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4397us (4712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131337.182806:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789131337.186078:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55a73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910371840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789131337.309806:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131337.390955:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131337.391051:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893588736 00000100:00100000:3.0:1789131337.391061:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893588736 00000100:00100000:3.0:1789131337.391125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:3.0:1789131337.391238:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:11611:x1876039893588736:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1789131337.391262:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131337.391282:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03983e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.391477:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.391491:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.391502:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131337.391513:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789131337.391632:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03983e expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.391648:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03983e expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.391656:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:3.0:1789131337.391670:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131337.391674:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e800, rc 0) 00000100:00100000:3.0:1789131337.391848:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11611:x1876039893588736:12345-192.168.203.52@tcp:101:cat.0 Request processed in 712us (901us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789131337.391856:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:2.0:1789131337.403594:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131337.403637:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131337.403754:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893588864 00000100:00100000:0.0:1789131337.403765:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893588864 00000100:00100000:0.0:1789131337.403841:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1789131337.403851:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:2353:x1876039893588864:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131337.403868:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131337.403893:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187904f54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03983e expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.403933:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131337.403938:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131337.404004:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:2353:x1876039893588864:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 155us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131337.404012:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1789131337.404371:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893589120 00000100:00100000:1.0:1789131337.404377:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893589120 00000100:00100000:1.0:1789131337.404410:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1789131337.404418:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:11611:x1876039893589120:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1789131337.404641:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11611:x1876039893589120:12345-192.168.203.52@tcp:35:cat.0 Request processed in 223us (1001us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789131337.404648:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1789131337.478070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131337.478230:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893589376 00000100:00100000:3.0:1789131337.478241:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893589376 00000100:00100000:3.0:1789131337.478302:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:3.0:1789131337.478312:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7ff04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11617:x1876039893589376:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:3.0:1789131337.478374:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131337.478378:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789131337.478404:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1800/0x9f0de37187904eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039814 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478424:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131337.478430:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131337.478443:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f62 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039845 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478527:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478541:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 41 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478549:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478578:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 41 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.478603:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 41 pid: 9425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131337.478616:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910371968:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131337.478716:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4de40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131337.482233:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131337.482372:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910371968:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131337.482401:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131337.482911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893589504 00000100:00100000:2.0:1789131337.482918:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893589504 00010000:00010000:2.0:1789131337.482955:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 42 pid: 9425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131337.482996:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1789131337.483006:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+42:2353:x1876039893589504:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131337.483020:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131337.483026:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 42 pid: 9425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483038:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 42 pid: 9425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483058:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187904f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039837 expref: 42 pid: 9425 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483072:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:2.0:1789131337.483812:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483823:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483844:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131337.483933:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131337.483997:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:2353:x1876039893589504:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 991us (1770us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131337.484006:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00010000:00010000:0.0:1789131337.486800:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.486816:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131337.486840:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789131337.487013:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187904f62 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 42 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.487034:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 41 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.487042:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131337.487045:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131337.487049:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f600, rc 0) 00000100:00100000:0.0:1789131337.487122:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7ff04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11617:x1876039893589376:12345-192.168.203.52@tcp:101:dd.0 Request processed in 8811us (9061us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1789131337.487304:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:3.0:1789131337.492549:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131337.492724:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893589760 00000100:00100000:0.0:1789131337.492735:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893589760 00000100:00100000:0.0:1789131337.492796:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:0.0:1789131337.492807:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11617:x1876039893589760:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1789131337.496469:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.496492:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.496504:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131337.496573:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1789131337.496598:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000088874d14 reply state 000000002f5416dc transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131337.496606:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131337.496723:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:11617:x1876039893589760:12345-192.168.203.52@tcp:36:dd.0 Request processed in 3914us (4178us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789131337.496732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000020:00080000:0.0:1789131337.496738:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789131337.500548:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500564:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500571:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500591:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131337.500596:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500604:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500619:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131337.500622:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131337.500627:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.500644:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187904f77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131337.947990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131337.948078:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893589888 00000100:00100000:0.0:1789131337.948087:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893589888 00000100:00100000:0.0:1789131337.948142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:0.0:1789131337.948156:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:11631:x1876039893589888:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1789131337.948186:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131337.948207:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03984c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948282:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948297:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948308:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948368:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948377:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948384:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948474:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948485:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 44 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948494:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948526:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 44 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.948539:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 44 pid: 8131 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131337.948553:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910372096:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131337.948643:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c435679c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131337.952474:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910372096:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131337.952506:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131337.953412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131337.953535:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893590144 00000100:00100000:1.0:1789131337.953544:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893590144 00000100:00100000:1.0:1789131337.953603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1789131337.953613:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:5589:x1876039893590144:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789131337.953946:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:5589:x1876039893590144:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 332us (535us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789131337.953955:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1789131337.958540:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131337.961021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893590272 00000100:00100000:0.0:1789131337.961036:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893590272 00010000:00010000:0.0:1789131337.961088:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 46 pid: 8131 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131337.961138:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1789131337.961149:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:2353:x1876039893590272:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131337.961163:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131337.961171:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 46 pid: 8131 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961184:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 46 pid: 8131 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961205:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187904f69 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039845 expref: 46 pid: 8131 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961222:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131337.961228:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961237:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961245:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131337.961618:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131337.961708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:2353:x1876039893590272:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 560us (3175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131337.961721:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00010000:00010000:3.0:1789131337.962165:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962175:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131337.962218:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789131337.962222:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131337.962241:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962253:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962764:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962771:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962792:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962797:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131337.962801:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962807:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131337.962824:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131337.962828:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962834:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de37187904f85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962846:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962851:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962856:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962860:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131337.962863:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962939:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962947:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392c900) 00010000:00010000:3.0:1789131337.962949:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131337.962952:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962958:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187904f8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.962998:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187904f7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03984c expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.963011:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03984c expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131337.963018:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:3.0:1789131337.963020:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131337.963022:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:3.0:1789131337.963132:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:11631:x1876039893589888:12345-192.168.203.52@tcp:101:stat.0 Request processed in 14981us (15150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131337.963141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:1.0:1789131338.051792:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.051858:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893590528 00000100:00100000:0.0:1789131338.051869:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893590528 00000100:00100000:0.0:1789131338.051947:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:0.0:1789131338.051958:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+44:11637:x1876039893590528:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:0.0:1789131338.052014:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131338.052043:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904f93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03984c expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.052063:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.052068:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131338.052283:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.052297:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.052307:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789131338.052423:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1789131338.052678:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1789131338.052710:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007886a7d2 reply state 000000005378d6a4 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131338.052720:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131338.052872:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:11637:x1876039893590528:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 915us (1089us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1789131338.052880:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000020:00080000:0.0:1789131338.052897:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789131338.059086:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059120:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059127:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059134:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131338.059139:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059147:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059163:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131338.059166:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131338.059171:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.059177:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187904f9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.253803:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.253920:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893590656 00000100:00100000:0.0:1789131338.253932:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893590656 00000100:00100000:0.0:1789131338.253992:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:0.0:1789131338.254003:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+45:11651:x1876039893590656:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1789131338.254027:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131338.254048:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fa1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039853 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254156:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254179:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254192:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254208:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254215:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254222:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254382:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254391:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254409:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131338.254446:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1789131338.254450:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131338.254681:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254695:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254704:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254710:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254717:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254723:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.254727:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254735:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254747:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131338.254750:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.254756:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254774:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fa8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254787:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254793:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254798:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254802:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.254805:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254811:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254818:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131338.254821:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.254824:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254830:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904faf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254863:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fa1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254876:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.254890:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.254893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131338.254895:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14600, rc 0) 00000100:00100000:0.0:1789131338.254965:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:11651:x1876039893590656:12345-192.168.203.52@tcp:101:stat.0 Request processed in 963us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131338.254974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00010000:00010000:0.0:1789131338.329719:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131338.347194:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131338.348782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893590912 00000100:00100000:3.0:1789131338.348793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893590912 00000100:00100000:3.0:1789131338.348854:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1789131338.348863:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+46:11661:x1876039893590912:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131338.348897:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131338.348916:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187904fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03985a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131338.349017:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1789131338.349137:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187904fbd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03985a expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.349156:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:3.0:1789131338.349160:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131338.349165:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187904fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03985a expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.349182:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fc00, rc 0) 00000100:00100000:3.0:1789131338.349305:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:11661:x1876039893590912:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 442us (2120us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789131338.349312:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1789131338.358639:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131338.358920:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893591168 00000100:00100000:1.0:1789131338.358930:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893591168 00000100:00100000:1.0:1789131338.358993:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1789131338.359005:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:11661:x1876039893591168:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131338.360246:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:11661:x1876039893591168:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 1229us (1602us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789131338.360257:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1789131338.472175:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.472383:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893591424 00000100:00100000:0.0:1789131338.472392:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893591424 00000100:00100000:0.0:1789131338.472451:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:0.0:1789131338.472515:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:11667:x1876039893591424:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131338.472544:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131338.472586:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039861 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.472686:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.472701:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.472710:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.472744:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.472776:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 49 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131338.472790:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910372224:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131338.472931:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c435676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131338.479515:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910372224:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131338.479517:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:0.0:1789131338.479544:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.479610:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893591552 00000100:00100000:1.0:1789131338.479616:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893591552 00010000:00010000:1.0:1789131338.479653:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 50 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.479693:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1789131338.479703:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:2353:x1876039893591552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131338.479718:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131338.479725:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 50 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479737:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 50 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479759:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187904fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039853 expref: 50 pid: 5845 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479775:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131338.479780:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479790:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479797:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.479840:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131338.479906:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:2353:x1876039893591552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 204us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131338.479914:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00010000:00010000:0.0:1789131338.481843:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.481856:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131338.481887:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789131338.482039:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 50 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.482058:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 49 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.482068:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.482071:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131338.482074:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131338.482134:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:11667:x1876039893591424:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9665us (9958us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1789131338.482160:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:3.0:1789131338.489643:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.490089:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893591808 00000100:00100000:0.0:1789131338.490100:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893591808 00000100:00100000:0.0:1789131338.490266:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:0.0:1789131338.490277:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+49:11667:x1876039893591808:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1789131338.490867:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.490885:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.490896:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131338.490956:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1789131338.490983:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000071e554ef reply state 00000000c01ba2c8 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131338.490991:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131338.491092:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11667:x1876039893591808:12345-192.168.203.52@tcp:36:bash.0 Request processed in 815us (1457us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1789131338.491100:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000020:00080000:0.0:1789131338.491105:0:5845:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789131338.496294:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496311:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496318:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496350:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131338.496355:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496362:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496380:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131338.496384:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131338.496388:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.496395:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187904fe0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131338.497894:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.498008:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893591936 00000100:00100000:0.0:1789131338.498018:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893591936 00000100:00100000:0.0:1789131338.498073:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:0.0:1789131338.498084:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:11667:x1876039893591936:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131338.498108:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131338.498153:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039868 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.498234:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.498248:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 52 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.498257:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.498290:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 52 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.498304:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 52 pid: 9425 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131338.498317:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910372352:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131338.498434:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c435679c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131338.504829:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.504952:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910372352:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131338.504981:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.505308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893592064 00000100:00100000:1.0:1789131338.505315:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893592064 00010000:00010000:1.0:1789131338.505388:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 53 pid: 9425 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.505436:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:1.0:1789131338.505446:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:2353:x1876039893592064:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131338.505534:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131338.505542:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 53 pid: 9425 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505554:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 53 pid: 9425 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505577:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187904fd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039861 expref: 53 pid: 9425 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505591:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131338.505596:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505604:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505611:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.505640:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131338.505748:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:2353:x1876039893592064:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 302us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131338.505756:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:3.0:1789131338.506941:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.506955:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131338.507002:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789131338.507018:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131338.507044:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.507079:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187904fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039868 expref: 52 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.507095:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039868 expref: 51 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131338.507102:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:3.0:1789131338.507105:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131338.507107:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15200, rc 0) 00000100:00100000:3.0:1789131338.507228:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:11667:x1876039893591936:12345-192.168.203.52@tcp:101:bash.0 Request processed in 9145us (9340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131338.507236:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:3.0:1789131338.510837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.510917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893592320 00000100:00100000:0.0:1789131338.510926:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893592320 00000100:00100000:0.0:1789131338.510976:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1789131338.510985:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:11667:x1876039893592320:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1789131338.511315:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11667:x1876039893592320:12345-192.168.203.52@tcp:35:bash.0 Request processed in 329us (486us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789131338.511366:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1789131338.646369:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131338.647819:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893592576 00000100:00100000:1.0:1789131338.647847:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893592576 00000100:00100000:1.0:1789131338.648046:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:1.0:1789131338.648058:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11677:x1876039893592576:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131338.648084:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131338.648105:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187904ff5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03986f expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131338.648214:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1789131338.648319:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187904ff5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03986f expref: 54 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.648370:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:1.0:1789131338.648374:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131338.648379:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187904ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03986f expref: 54 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.648407:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5400, rc 0) 00000100:00100000:1.0:1789131338.648482:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:11677:x1876039893592576:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 427us (2123us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789131338.648489:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:3.0:1789131338.657874:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.658020:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893592704 00000100:00100000:0.0:1789131338.658031:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893592704 00000100:00100000:0.0:1789131338.658092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:0.0:1789131338.658102:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:11677:x1876039893592704:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1789131338.658176:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658193:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658207:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658223:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658230:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658237:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658377:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658550:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658560:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131338.658764:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658779:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658787:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658795:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658802:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.658806:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658814:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658826:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131338.658828:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.658833:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658839:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658852:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658868:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658880:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658885:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.658888:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.658894:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659012:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131338.659016:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.659020:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659027:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790500a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659042:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659049:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659056:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659062:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.659065:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659082:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659090:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.659092:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.659096:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.659102:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131338.659187:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:11677:x1876039893592704:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1084us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131338.659197:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:0.0:1789131338.673674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131338.673827:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893592960 00000100:00100000:2.0:1789131338.673837:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893592960 00000100:00100000:2.0:1789131338.673908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1789131338.673918:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+53:11677:x1876039893592960:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1789131338.674173:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11677:x1876039893592960:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 256us (508us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789131338.674181:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1789131338.755704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.755871:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893593216 00000100:00100000:0.0:1789131338.755882:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893593216 00000100:00100000:0.0:1789131338.755944:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:0.0:1789131338.755954:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11680:x1876039893593216:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131338.755977:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131338.755996:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039876 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756071:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756085:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756111:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756126:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756134:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756140:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756259:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790502d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756269:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756276:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790502d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131338.756287:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789131338.756447:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756455:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756461:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756467:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.756477:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756485:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756497:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131338.756500:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.756504:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756510:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790501f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756524:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756530:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756536:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756541:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131338.756544:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756550:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756557:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131338.756559:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131338.756569:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756575:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756617:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039876 expref: 57 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756629:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790502d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039876 expref: 56 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.756636:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.756639:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131338.756641:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15c00, rc 0) 00000100:00100000:0.0:1789131338.757270:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a5a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11680:x1876039893593216:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1313us (1574us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789131338.757279:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:3.0:1789131338.764634:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131338.764687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131338.764764:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893593472 00000100:00100000:1.0:1789131338.764774:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893593472 00000100:00100000:1.0:1789131338.764832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:1.0:1789131338.764842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11680:x1876039893593472:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1789131338.764922:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.764948:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.764975:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765000:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765007:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765014:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765020:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131338.765024:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765031:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765042:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131338.765045:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131338.765049:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131338.765055:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790503b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131338.765135:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11680:x1876039893593472:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 287us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131338.765153:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:0.0:1789131338.770728:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893593344 00000100:00100000:0.0:1789131338.770743:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893593344 00000100:00100000:0.0:1789131338.770811:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1789131338.770821:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:2355:x1876039893593344:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131338.770837:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131338.770873:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790502d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039876 expref: 56 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.770892:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.770897:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131338.771432:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:2355:x1876039893593344:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 609us (6741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131338.771441:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1789131338.777679:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131338.778007:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893593728 00000100:00100000:2.0:1789131338.778017:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893593728 00000100:00100000:2.0:1789131338.778081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1789131338.778092:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:11680:x1876039893593728:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1789131338.778305:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11680:x1876039893593728:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 215us (636us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789131338.778314:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1789131338.984234:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131338.986641:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893593984 00000100:00100000:0.0:1789131338.986654:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893593984 00000100:00100000:0.0:1789131338.986780:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1789131338.986790:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11698:x1876039893593984:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1789131338.986822:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131338.986844:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03987d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.986952:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.986967:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.986978:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131338.986988:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789131338.987139:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03987d expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.987159:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03987d expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131338.987167:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:0.0:1789131338.987171:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131338.987189:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131338.987263:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11698:x1876039893593984:12345-192.168.203.52@tcp:101:cat.0 Request processed in 474us (3039us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789131338.987271:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:3.0:1789131339.017057:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.020757:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893594112 00000100:00100000:0.0:1789131339.020777:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893594112 00000100:00100000:1.0:1789131339.020991:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1789131339.021004:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11699:x1876039893594112:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131339.021042:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131339.021073:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039884 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.022604:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.022631:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.022646:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131339.022860:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1789131339.022865:0:8131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131339.022894:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.023137:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039884 expref: 60 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.023362:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039884 expref: 59 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.023372:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131339.023375:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789131339.023399:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5600, rc 0) 00000100:00100000:1.0:1789131339.023577:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11699:x1876039893594112:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2575us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131339.023588:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1789131339.028718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.028829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893594496 00000100:00100000:0.0:1789131339.028842:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893594496 00000100:00100000:0.0:1789131339.028910:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131339.028922:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11699:x1876039893594496:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131339.029465:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11699:x1876039893594496:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 541us (759us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1789131339.029475:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1789131339.034192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.034398:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893594624 00000100:00100000:1.0:1789131339.034411:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893594624 00000100:00100000:1.0:1789131339.034508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1789131339.034521:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11699:x1876039893594624:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:1.0:1789131339.034542:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131339.034578:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de37187904fee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039868 expref: 60 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.034607:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03987d expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.034622:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187904ef9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039829 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.034640:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c5855b100) 00010000:00010000:1.0:1789131339.034657:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131339.034735:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11699:x1876039893594624:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 216us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131339.034748:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131339.037734:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.038106:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893594752 00000100:00100000:1.0:1789131339.038119:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893594752 00000100:00100000:1.0:1789131339.038408:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:1.0:1789131339.038592:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11699:x1876039893594752:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1789131339.038816:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.038837:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.038853:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131339.039126:0:9425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789131339.039909:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11699:x1876039893594752:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 1486us (2184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131339.039922:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:2.0:1789131339.080316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.080626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893594880 00000100:00100000:0.0:1789131339.080641:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893594880 00000100:00100000:0.0:1789131339.080726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:0.0:1789131339.080737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11701:x1876039893594880:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131339.080776:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131339.080803:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790506c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03988b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081017:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081035:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081050:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081085:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081093:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081100:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081224:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081234:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081242:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131339.081793:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789131339.081799:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131339.081880:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081896:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081905:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081912:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081937:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081944:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.081949:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081957:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081971:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131339.081975:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131339.081981:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.081988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905073 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082006:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082012:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082017:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082022:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.082025:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082041:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082050:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131339.082052:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131339.082055:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082061:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de3718790507a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082105:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de3718790506c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082120:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.082127:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:0.0:1789131339.082129:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131339.082132:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:0.0:1789131339.082224:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11701:x1876039893594880:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1488us (1923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.082234:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00000040:00080000:3.0:1789131339.353565:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131339.353581:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131339.353812:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789131339.353822:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131339.353981:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910372480:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131339.354135:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d000 going to sleep for 11 seconds 00010000:00010000:3.0:1789131339.354990:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131339.364653:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.364974:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893595008 00000100:00100000:2.0:1789131339.364995:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893595008 00000100:00100000:2.0:1789131339.365063:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:2.0:1789131339.365074:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595008:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131339.365114:0:8131:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131339.365271:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595008:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 199us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.365280:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1789131339.371214:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910372480:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789131339.373462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.376387:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893595136 00000100:00100000:0.0:1789131339.376409:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893595136 00000100:00100000:0.0:1789131339.376495:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:0.0:1789131339.376508:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11712:x1876039893595136:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131339.380755:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.380779:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.380791:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.380806:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.380813:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.380980:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381012:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381021:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381028:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131339.381084:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789131339.381088:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131339.381101:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381113:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381144:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381151:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381158:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.381162:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381169:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381182:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131339.381185:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131339.381189:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381195:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905088 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381211:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381217:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381223:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381228:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.381236:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381242:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381250:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131339.381252:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131339.381255:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381260:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790508f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381274:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381280:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381286:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381291:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.381426:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381435:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381444:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:0.0:1789131339.381447:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131339.381456:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.381462:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131339.381567:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11712:x1876039893595136:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 5056us (8109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.381578:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:2.0:1789131339.389835:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.390159:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893595392 00000100:00100000:0.0:1789131339.390170:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893595392 00000100:00100000:0.0:1789131339.390229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:0.0:1789131339.390244:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11712:x1876039893595392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131339.390265:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131339.390284:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de3718790509d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039892 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.390420:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.390436:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.390448:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131339.390538:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789131339.390840:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.390849:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.390870:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391015:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131339.391021:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391030:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391043:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:0.0:1789131339.391046:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131339.391123:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391132:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de371879050a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391181:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de3718790509d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039892 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391191:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131339.391193:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131339.391197:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de3718790509d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039892 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.391206:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14600, rc 0) 00000100:00100000:0.0:1789131339.391369:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1131us (1543us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1789131339.391387:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:2.0:1789131339.399230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.399919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893595520 00000100:00100000:1.0:1789131339.399931:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893595520 00000100:00100000:1.0:1789131339.400052:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:1.0:1789131339.400064:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595520:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789131339.400111:0:5846:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789131339.400264:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595520:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 202us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131339.400274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:2.0:1789131339.405441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.406085:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893595776 00000100:00100000:0.0:1789131339.406100:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893595776 00000100:00100000:0.0:1789131339.406186:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:0.0:1789131339.406196:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893595776:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131339.406222:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131339.406225:0:9425:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131339.406256:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790505e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039884 expref: 59 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.406290:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131339.406297:0:9425:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131339.406313:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de371879050b2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039899 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131339.407970:0:9425:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789131339.408782:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0600/0x9f0de371879050b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.408807:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0600/0x9f0de371879050b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.408821:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0600/0x9f0de371879050b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.408908:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de371879050b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039899 expref: 61 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.408929:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0600/0x9f0de371879050b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039899 expref: 60 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.408938:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855bd00) 00010000:00010000:2.0:1789131339.408941:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131339.408946:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0600, rc 0) 00000100:00100000:2.0:1789131339.409078:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11712:x1876039893595776:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2882us (3652us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789131339.409104:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:3.0:1789131339.433093:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.438134:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596032 00000100:00100000:0.0:1789131339.439130:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596032 00000100:00100000:1.0:1789131339.439603:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:1.0:1789131339.439618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11712:x1876039893596032:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131339.439698:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131339.439735:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0600/0x9f0de371879050b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039899 expref: 60 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.439785:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855bd00) 00010000:00010000:1.0:1789131339.439801:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131339.439832:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.439848:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.439860:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440026:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440173:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440254:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440478:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440485:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440492:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440498:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.440502:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440523:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440536:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131339.440539:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131339.440544:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440552:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de371879050c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440569:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440576:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440582:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440586:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.440589:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440607:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440615:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x585377a5 (ffff9c0c47f35900) 00010000:00010000:1.0:1789131339.440617:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131339.440620:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.440636:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x585377a5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.440749:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893596032:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1128us (7666us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131339.440758:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:0.0:1789131339.449036:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.449188:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596160 00000100:00100000:2.0:1789131339.449204:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596160 00000100:00100000:2.0:1789131339.449451:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:2.0:1789131339.449462:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11712:x1876039893596160:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131339.449485:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131339.449508:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398a0 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449547:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449561:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449574:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449684:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 61 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449703:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 60 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.449712:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:2.0:1789131339.449715:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789131339.449718:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1a00, rc 0) 00000100:00100000:2.0:1789131339.449786:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11712:x1876039893596160:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 327us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.449801:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:0.0:1789131339.454191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.459558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596416 00000100:00100000:1.0:1789131339.459573:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596416 00000100:00100000:1.0:1789131339.459640:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:1.0:1789131339.459651:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11712:x1876039893596416:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131339.459732:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.459751:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.459763:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131339.460086:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789131339.460097:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351433774928ns, next at 352433772258ns, rc = 0 00000004:00010000:1.0:1789131339.460206:0:5846:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009736b34c reply state 000000007229127d transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.460216:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131339.460311:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11712:x1876039893596416:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 661us (6135us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789131339.460348:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 178 00010000:00010000:1.0:1789131339.491439:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491456:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491465:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491473:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.491478:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491485:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491503:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:1.0:1789131339.491506:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131339.491512:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.491518:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de371879050e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131339.493791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.494038:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596544 00000100:00100000:2.0:1789131339.494050:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596544 00000100:00100000:2.0:1789131339.494123:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:2.0:1789131339.494134:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11712:x1876039893596544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131339.494160:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131339.494189:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398a7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.494245:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.494259:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.494278:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:2.0:1789131339.494281:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131339.494285:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1200, rc 0) 00000100:00100000:2.0:1789131339.494361:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11712:x1876039893596544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 228us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.494369:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:2.0:1789131339.502689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.502771:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596672 00000100:00100000:1.0:1789131339.502781:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596672 00000100:00100000:1.0:1789131339.502844:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1789131339.502854:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+6:2352:x1876039893596672:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789131339.503207:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893596672:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 354us (523us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789131339.503217:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00080000:2.0:1789131339.503784:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131339.507978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.508357:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893596928 00000100:00100000:2.0:1789131339.508368:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893596928 00000100:00100000:2.0:1789131339.508417:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1789131339.508425:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11712:x1876039893596928:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789131339.508657:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+63:11712:x1876039893596928:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 231us (687us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789131339.508665:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1789131339.518127:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.518403:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597184 00000100:00100000:2.0:1789131339.518413:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597184 00000100:00100000:2.0:1789131339.518467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:2.0:1789131339.518477:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+63:11712:x1876039893597184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131339.518579:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+63:11712:x1876039893597184:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 102us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.518586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:2.0:1789131339.521025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131339.521446:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597312 00000100:00100000:3.0:1789131339.521456:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597312 00000100:00100000:3.0:1789131339.521512:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1789131339.521522:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+63:11712:x1876039893597312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131339.521544:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131339.521564:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879050f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398ae expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521632:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521646:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521657:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131339.521699:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131339.521718:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521745:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de371879050f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ae expref: 65 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521778:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ae expref: 64 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.521786:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:3.0:1789131339.521789:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789131339.521793:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ee00, rc 0) 00000100:00100000:3.0:1789131339.521849:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11712:x1876039893597312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 329us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.521857:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:2.0:1789131339.533279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.533435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.533504:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597440 00000100:00100000:0.0:1789131339.533516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597440 00000100:00100000:0.0:1789131339.533564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00100000:0.0:1789131339.533575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893597440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131339.533579:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597568 00000100:00100000:3.0:1789131339.533583:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597568 00000100:00100000:2.0:1789131339.533625:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131339.533634:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1789131339.533643:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893597568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131339.533652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597696 00000100:00100000:2.0:1789131339.533658:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597696 00000100:00100000:0.0:1789131339.533660:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893597440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 87us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.533670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 321 00000100:00100000:3.0:1789131339.533672:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893597568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.533678:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1789131339.533698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00080000:3.0:1789131339.533701:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131339.533707:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131339.533709:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893597696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131339.533745:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2355:x1876039893597696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.533763:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.533866:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:3.0:1789131339.534633:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893597824 00000100:00100000:3.0:1789131339.534640:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893597824 00000100:00100000:3.0:1789131339.534691:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1789131339.534699:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893597824:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789131339.534714:0:8327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131339.534735:0:8327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398b5 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131339.534782:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3fa4c, blocks: 0x1 00010000:00010000:3.0:1789131339.534801:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789131339.534806:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131339.534816:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 8 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.534836:0:8327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 8 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.534861:0:8327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ea00, rc 0) 00000100:00100000:3.0:1789131339.534904:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893597824:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 205us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.534911:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1789131339.545096:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.545236:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598080 00000100:00100000:2.0:1789131339.545246:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598080 00000100:00100000:2.0:1789131339.545310:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1789131339.545370:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11712:x1876039893598080:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789131339.545479:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11712:x1876039893598080:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 112us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.545486:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1789131339.549187:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.549272:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598208 00000100:00100000:0.0:1789131339.549282:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598208 00000100:00100000:0.0:1789131339.549456:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1789131339.549467:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:11712:x1876039893598208:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131339.549485:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131339.549504:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398bc expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.549537:0:6706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.549546:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131339.549550:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131339.549556:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.549590:0:6706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.549605:0:6706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131339.549639:0:6706:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7474e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910372608:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131339.549721:0:6706:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c435676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131339.554776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.554911:0:6706:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7474e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6706:1876039910372608:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131339.554945:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.554966:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:2.0:1789131339.555035:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:11712:x1876039893598208:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5569us (5856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.555045:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1789131339.556506:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598336 00000100:00100000:3.0:1789131339.556518:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598336 00010000:00010000:2.0:1789131339.564444:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.564537:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:2.0:1789131339.564553:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893598336:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131339.564570:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131339.564593:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.564617:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.564658:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce8e0ac0/0x9f0de371879050ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398b5 expref: 9 pid: 8327 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.564674:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131339.564679:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131339.564687:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.564697:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.564738:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.564752:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876039910372736:192.168.203.52@tcp:105: 00000100:00100000:2.0:1789131339.564846:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131339.573763:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5830:1876039910372736:192.168.203.52@tcp:105: 00010000:00010000:2.0:1789131339.573790:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131339.573845:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893598336:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 9299us (19077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.573857:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1789131339.574648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.574769:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598464 00000100:00100000:1.0:1789131339.574778:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598464 00002000:00100000:1.0:1789131339.574824:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c0c55ac4b40 x1876039893598464/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:300/0 lens 504/0 e 0 to 0 dl 1789131350 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131339.574835:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c55ac4b40 with x1876039893598464 ext(0->8) 00002000:00010000:1.0:1789131339.574840:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c55ac4b40 00000100:00100000:1.0:1789131339.574880:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1789131339.574891:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893598464:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789131339.575359:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893598464:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 469us (712us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789131339.575369:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00002000:00100000:1.0:1789131339.575376:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c0c55ac4b40 x1876039893598464/t4294967314(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:300/0 lens 504/448 e 0 to 0 dl 1789131350 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131339.575385:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c55ac4b40 with x1876039893598464 ext(0->8) 00002000:00010000:1.0:1789131339.575389:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c55ac4b40 00000100:00100000:3.0:1789131339.577612:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.577689:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598592 00000100:00100000:0.0:1789131339.577697:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598592 00000100:00100000:0.0:1789131339.577757:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:0.0:1789131339.577767:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11712:x1876039893598592:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789131339.648351:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11712:x1876039893598592:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 70547us (70709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.648364:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000001:00080000:0.0:1789131339.648399:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:0.0:1789131339.648438:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1789131339.648442:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:0.0:1789131339.648468:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1789131339.648478:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789131339.648490:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c4367ca80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789131339.648493:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c437c4d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c4367cb40 00000020:00080000:0.0:1789131339.648496:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c437c4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c5fc9dc00 00000020:00080000:0.0:1789131339.648543:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789131339.648717:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789131339.648923:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910372992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789131339.648977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131339.649358:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910372864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789131339.651539:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910372992 00000100:00100000:3.0:1789131339.651551:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910372992 00000100:00100000:3.0:1789131339.651652:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789131339.651662:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910372992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789131339.651694:0:6704:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1789131339.651726:0:6704:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3fa49, atime: 0x6aa3fa49, ctime: 0x6aa3fa49, blocks: 0x1 00010000:00010000:3.0:1789131339.651733:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.651748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131339.651759:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1789131339.651764:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131339.651771:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.651778:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910372864 00000100:00100000:2.0:1789131339.651781:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910372864 00010000:00010000:3.0:1789131339.651786:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.651796:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.651808:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.651824:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789131339.652367:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1876039910372992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 706us (3388us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789131339.652376:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00010000:3.0:1789131339.652402:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131339.652408:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.652416:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131339.652420:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.652440:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.652457:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.652465:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de3718790510d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.652481:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131339.652483:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131339.652485:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789131339.652516:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c55b4e580/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789131339.652523:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910372992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131339.653497:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.653535:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598720 00000100:00100000:0.0:1789131339.653547:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598720 00000100:00100000:0.0:1789131339.653587:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1789131339.653595:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2354:x1876039893598720:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1789131339.654025:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131339.654048:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131339.661200:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131339.661217:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910372864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789131339.662044:0:6705:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789131339.662051:0:6705:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789131340 00002000:00010000:2.0:1789131339.662054:0:6705:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789131339.662117:0:6705:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789131340 -> 1789131340 00002000:00010000:2.0:1789131339.662121:0:6705:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789131339.662263:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910372864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1051us (10513us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789131339.662273:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1789131339.664263:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c55b4de00/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789131339.664275:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910372864:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789131339.725412:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789131339.726029:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893598720:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 72427us (72530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.726041:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1789131339.732754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.732851:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893598976 00000100:00100000:2.0:1789131339.732861:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893598976 00000100:00100000:2.0:1789131339.732924:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:2.0:1789131339.732934:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11712:x1876039893598976:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131339.732986:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131339.733013:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ee00/0x9f0de371879050f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ae expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.733034:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:2.0:1789131339.733040:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131339.733071:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.733085:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131339.733108:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131339.733364:0:5846:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bf521c8e reply state 000000009df5c144 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.733373:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131339.733459:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11712:x1876039893598976:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 525us (713us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789131339.733466:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:0.0:1789131339.737484:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131339.737578:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893599104 00000100:00100000:2.0:1789131339.737587:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893599104 00000100:00100000:2.0:1789131339.737640:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:2.0:1789131339.737649:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893599104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131339.737829:0:8327:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789131339.737832:0:8327:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789131340 -> 1789131339 00002000:00010000:2.0:1789131339.737835:0:8327:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789131337 00002000:00010000:2.0:1789131339.737837:0:8327:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789131340 -> 1789131339 00002000:00010000:2.0:1789131339.737839:0:8327:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789131339.737891:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893599104:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 243us (419us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789131339.737898:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:1.0:1789131339.738179:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738190:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738198:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738213:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.738218:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738225:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738239:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:1.0:1789131339.738242:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131339.738247:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.738252:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905114 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.744427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131339.744503:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893599360 00000100:00100000:3.0:1789131339.744513:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893599360 00000100:00100000:3.0:1789131339.744579:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1789131339.744589:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11712:x1876039893599360:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789131339.744658:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.744676:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 18 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.744686:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.744730:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 18 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.744745:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 18 pid: 8131 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.744759:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910373120:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131339.744852:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d300 going to sleep for 11 seconds 00000100:00100000:3.0:1789131339.754446:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac5680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910373120:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131339.754480:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.755662:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131339.755884:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893599488 00000100:00100000:3.0:1789131339.755893:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893599488 00010000:00010000:3.0:1789131339.755933:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 19 pid: 8131 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.755969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1789131339.756005:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:2353:x1876039893599488:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131339.756019:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131339.756027:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 19 pid: 8131 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756040:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 19 pid: 8131 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756076:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879050dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a0 expref: 19 pid: 8131 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756090:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:3.0:1789131339.756094:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756102:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756109:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756134:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131339.756180:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:2353:x1876039893599488:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 203us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.756188:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:3.0:1789131339.756298:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756307:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756360:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756368:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756374:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756387:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131339.756391:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756398:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756407:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:3.0:1789131339.756410:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789131339.756414:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.756420:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de3718790511b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.756461:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:11712:x1876039893599360:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 11873us (12044us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789131339.756470:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:2.0:1789131339.763532:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.765579:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893599616 00000100:00100000:1.0:1789131339.765594:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893599616 00000100:00100000:1.0:1789131339.765682:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1789131339.765693:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893599616:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789131339.765736:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.765754:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.765763:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131339.765768:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131339.765772:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.765812:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.765825:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 8 pid: 6706 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.765838:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1876039910373248:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131339.765926:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74d70c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131339.768801:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6704:1876039910373248:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131339.768829:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131339.769485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.769668:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893599744 00000100:00100000:0.0:1789131339.769676:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893599744 00010000:00010000:0.0:1789131339.769712:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131339.769752:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1789131339.769762:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893599744:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131339.769776:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131339.769798:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.769810:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.769833:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da736ca2/0x9f0de37187905106 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398bc expref: 9 pid: 6706 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.769847:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131339.769859:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131339.769865:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.769875:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.769938:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131339.769990:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2353:x1876039893599744:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 231us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131339.769999:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00010000:00010000:1.0:1789131339.770470:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770480:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770505:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770513:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770534:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770542:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131339.770546:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770555:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770568:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.770575:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de37187905122 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.770633:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893599616:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 4942us (7110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131339.770642:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:2.0:1789131339.773742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.773812:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600000 00000100:00100000:0.0:1789131339.773821:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600000 00000100:00100000:0.0:1789131339.773878:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:0.0:1789131339.773888:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+17:11712:x1876039893600000:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789131339.773965:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.773981:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.773991:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.774549:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.774563:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.774589:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.774619:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.774631:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 18 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131339.774644:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910373376:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131339.774713:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131339.779941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.780179:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910373376:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131339.780209:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.780812:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600128 00000100:00100000:3.0:1789131339.780820:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600128 00010000:00010000:3.0:1789131339.780862:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.780901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1789131339.780912:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:2352:x1876039893600128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131339.780924:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131339.780931:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.780964:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.780985:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879050ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398a7 expref: 19 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.781010:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:3.0:1789131339.781016:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.781264:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.781309:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.781509:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131339.781562:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:2352:x1876039893600128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 651us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.781570:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:1.0:1789131339.781618:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.781626:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131339.781813:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1789131339.781978:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1789131339.782024:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1789131339.782104:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910373504:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131339.782274:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131339.782402:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4374fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131339.782441:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910373504 00000100:00100000:2.0:1789131339.782448:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910373504 00000100:00100000:2.0:1789131339.782484:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789131339.782493:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910373504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131339.782564:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910373504:12345-0@lo:1000:mdt00_003.0 Request processed in 73us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131339.782572:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131339.782935:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910373504:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1789131339.784038:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1789131339.784127:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910373632:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789131339.784182:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131339.784214:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131339.785681:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910373632 00000100:00100000:2.0:1789131339.785693:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910373632 00000100:00100000:2.0:1789131339.785748:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131339.785757:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8131:x1876039910373632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131339.786828:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:8131:x1876039910373632:12345-0@lo:1000:mdt00_003.0 Request processed in 1067us (2641us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789131339.786838:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8131:1876039910373632:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789131339.786840:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1789131339.787489:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787499:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787506:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787512:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.787516:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787534:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787732:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c5855be00) 00010000:00010000:1.0:1789131339.787736:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131339.787755:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787762:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14000/0x9f0de37187905130 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787793:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787800:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787805:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787809:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.787812:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787818:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787831:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131339.787834:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131339.787837:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787842:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de37187905065 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787863:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787877:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787904:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787942:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.787959:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 21 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.787973:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910373760:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131339.788056:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131339.801775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131339.801899:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a7f4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910373760:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131339.801927:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.802229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600256 00000100:00100000:3.0:1789131339.802244:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600256 00010000:00010000:3.0:1789131339.802300:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 22 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131339.802384:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1789131339.802395:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:2353:x1876039893600256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131339.802432:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131339.802441:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 22 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802455:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 22 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802483:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de37187905081 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03988b expref: 22 pid: 5845 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802728:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:3.0:1789131339.802735:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802746:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802755:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131339.802793:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131339.802870:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:2353:x1876039893600256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 476us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131339.802882:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00010000:00010000:1.0:1789131339.802885:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802898:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802913:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802919:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802926:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802948:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.802952:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802960:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802977:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131339.802980:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131339.802984:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.802991:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905137 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803006:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803012:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803018:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803023:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131339.803026:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803032:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803051:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131339.803053:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131339.803056:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.803062:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14400/0x9f0de37187905129 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131339.803531:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11712:x1876039893600000:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 29639us (29791us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789131339.803544:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000020:00080000:1.0:1789131339.803558:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789131339.803914:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131339.803919:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131339.804477:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789131339.804488:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131339.814713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131339.816298:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600512 00000100:00100000:0.0:1789131339.816336:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600512 00000100:00100000:0.0:1789131339.816398:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1789131339.816408:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11712:x1876039893600512:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789131339.818448:0:5848:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789131339.819911:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1789131339.820050:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.820067:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.820093:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.820102:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.820108:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.820178:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131339.823373:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789131339.823514:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493db850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:11712:x1876039893600512:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 7102us (8805us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789131339.823525:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000020:00080000:0.0:1789131339.823531:0:5848:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789131339.824236:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131339.824245:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.824255:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131339.824259:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.824268:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.824285:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131339.824288:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789131339.824293:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.824299:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de3718790513e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131339.824358:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131339.824360:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131339.824362:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131339.977825:0:12881:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789131339.977836:0:12881:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789131339.977873:0:12881:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789131339.977878:0:12881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131340.105178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.105248:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600768 00000100:00100000:1.0:1789131340.105258:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600768 00000100:00100000:1.0:1789131340.105365:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1789131340.105378:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:11722:x1876039893600768:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131340.105403:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131340.105425:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398c3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789131340.105495:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131340.105683:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de3718790514c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.105697:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de3718790514c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.105711:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de3718790514c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131340.105724:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1789131340.105911:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398c3 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.105931:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de3718790514c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398c3 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.105949:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131340.105952:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789131340.105955:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4a00, rc 0) 00000100:00100000:1.0:1789131340.106013:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11722:x1876039893600768:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 638us (846us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789131340.106021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1789131340.111438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.115424:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893600896 00000100:00100000:0.0:1789131340.115438:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893600896 00000100:00100000:0.0:1789131340.115556:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:0.0:1789131340.115568:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11722:x1876039893600896:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1789131340.115642:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115658:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115671:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115696:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115704:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115713:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.115998:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116006:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116014:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131340.116050:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116061:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116067:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116074:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116097:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.116101:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116116:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116128:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131340.116131:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.116136:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116142:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790515a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116151:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116156:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116161:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116165:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.116168:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116173:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116180:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131340.116182:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.116184:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116199:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116214:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116229:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116234:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116239:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.116242:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116248:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116255:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c4392c500) 00010000:00010000:0.0:1789131340.116257:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.116260:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.116265:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.116371:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11722:x1876039893600896:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 804us (4942us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131340.116379:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:2.0:1789131340.182251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.184724:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893601152 00000100:00100000:1.0:1789131340.184735:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893601152 00000100:00100000:1.0:1789131340.184844:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1789131340.184854:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11725:x1876039893601152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131340.184874:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131340.184895:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790516f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398ca expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.184967:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.184982:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.184993:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.185009:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.185017:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.185041:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186385:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186400:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186410:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131340.186420:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789131340.186529:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186537:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186544:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186550:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.186554:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186562:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186574:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131340.186577:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.186588:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186594:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186607:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186613:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186618:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186623:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.186626:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186632:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186640:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131340.186642:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.186645:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186650:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de3718790517d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186696:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790516f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 27 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186722:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 26 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.186730:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131340.186732:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131340.186734:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4200, rc 0) 00000100:00100000:1.0:1789131340.186806:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11725:x1876039893601152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1954us (4564us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789131340.186816:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:1.0:1789131340.192977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131340.193091:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893601280 00000100:00100000:3.0:1789131340.193102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893601280 00000100:00100000:3.0:1789131340.193222:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:3.0:1789131340.193232:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11725:x1876039893601280:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1789131340.193299:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193352:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193366:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193393:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193400:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193407:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193413:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fc00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131340.193417:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193424:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193436:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:3.0:1789131340.193451:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131340.193457:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.193464:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131340.193533:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11725:x1876039893601280:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 302us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131340.193541:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:3.0:1789131340.196599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.196871:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893601536 00000100:00100000:1.0:1789131340.196880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893601536 00000100:00100000:1.0:1789131340.196964:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1789131340.196976:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11725:x1876039893601536:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131340.197208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:11725:x1876039893601536:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 234us (618us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1789131340.197217:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1789131340.249555:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789131340.249581:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910373888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131340.249655:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131340.249778:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910373888 00000100:00100000:3.0:1789131340.249786:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910373888 00000100:00100000:3.0:1789131340.249881:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789131340.249892:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910373888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131340.249929:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131340.249987:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910373888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131340.249995:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789131340.250048:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55ac4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910373888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131340.262189:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.262456:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893601792 00000100:00100000:1.0:1789131340.262467:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893601792 00000100:00100000:1.0:1789131340.262526:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:1.0:1789131340.262536:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:11260:x1876039893601792:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131340.262560:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131340.262594:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905199 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398d1 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.262693:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.262708:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 28 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.262717:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.262750:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 28 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.262775:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 28 pid: 8131 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.262789:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910374016:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131340.262983:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74d70540 going to sleep for 11 seconds 00000100:00100000:1.0:1789131340.265437:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403e580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910374016:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131340.265466:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.274361:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131340.276562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893601920 00000100:00100000:3.0:1789131340.276575:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893601920 00010000:00010000:3.0:1789131340.276624:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 29 pid: 8131 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131340.276723:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1789131340.276733:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:2353:x1876039893601920:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131340.276748:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131340.276756:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 29 pid: 8131 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276781:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 29 pid: 8131 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276803:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de37187905184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ca expref: 29 pid: 8131 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276819:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:3.0:1789131340.276824:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276833:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276841:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.276872:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131340.276943:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:2353:x1876039893601920:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 211us (2591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131340.276950:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:0.0:1789131340.277055:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.277064:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131340.277082:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789131340.277231:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de37187905199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 29 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.277248:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 28 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.277256:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:0.0:1789131340.277259:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131340.277262:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4c00, rc 0) 00000100:00100000:0.0:1789131340.277296:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:11260:x1876039893601792:12345-192.168.203.52@tcp:101:bash.0 Request processed in 14762us (15118us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1789131340.277303:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1789131340.280440:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.280537:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602176 00000100:00100000:1.0:1789131340.280546:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602176 00000100:00100000:1.0:1789131340.280595:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:1.0:1789131340.280605:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:11260:x1876039893602176:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1789131340.281232:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.281263:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.281275:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131340.281359:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1789131340.281386:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000063e9cfe4 reply state 00000000e3bcb2e0 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.281395:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789131340.281439:0:8131:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1789131340.281552:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11260:x1876039893602176:12345-192.168.203.52@tcp:36:bash.0 Request processed in 947us (1120us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789131340.281561:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000020:00080000:1.0:1789131340.281566:0:8131:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789131340.283603:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283618:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283625:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283631:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.283637:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283644:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283678:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131340.283681:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.283687:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.283693:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.287993:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.288264:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602304 00000100:00100000:1.0:1789131340.288275:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602304 00000100:00100000:3.0:1789131340.288362:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1789131340.288378:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:11260:x1876039893602304:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1789131340.288404:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131340.288774:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de371879051b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398d8 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.289345:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de371879051b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d8 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.289366:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de371879051b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d8 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.289408:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:2.0:1789131340.289412:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131340.289416:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0200, rc 0) 00000100:00100000:2.0:1789131340.289564:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55a70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11260:x1876039893602304:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1190us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131340.289573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:2.0:1789131340.298898:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.298988:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602432 00000100:00100000:0.0:1789131340.298998:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602432 00000100:00100000:0.0:1789131340.299059:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1789131340.299070:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:11260:x1876039893602432:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131340.299090:0:12438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131340.299124:0:12438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398df expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131340.299154:0:12438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3fa4b, atime: 0x6aa3fa49, ctime: 0x6aa3fa4b, blocks: 0xb 00010000:00010000:0.0:1789131340.299177:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789131340.299182:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131340.299192:0:12438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 8 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.299210:0:12438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 8 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.299223:0:12438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14a00, rc 0) 00000100:00100000:0.0:1789131340.299392:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:11260:x1876039893602432:12345-192.168.203.52@tcp:101:bash.0 Request processed in 322us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131340.299400:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1789131340.318420:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.318516:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602560 00000100:00100000:1.0:1789131340.318527:0:6710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602560 00002000:00010000:1.0:1789131340.318567:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789131340.318573:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7a67cf00 with x1876039893602560 ext(0->18446744073709551615) 00002000:00010000:1.0:1789131340.318584:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7a67cf00. 00000100:00100000:1.0:1789131340.318620:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1789131340.318630:0:6710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893602560:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:1.0:1789131340.318899:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789131340.318903:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789131339 -> 1789131340 00002000:00010000:1.0:1789131340.318906:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789131337 -> 1789131337 00002000:00010000:1.0:1789131340.318908:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789131339 -> 1789131340 00002000:00010000:1.0:1789131340.318911:0:6710:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1789131340.318971:0:6710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893602560:12345-192.168.203.52@tcp:10:bash.0 Request processed in 342us (558us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789131340.318979:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00010000:1.0:1789131340.318983:0:6710:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1789131340.318986:0:6710:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7a67cf00 with x1876039893602560 ext(0->18446744073709551615) 00002000:00010000:1.0:1789131340.319002:0:6710:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7a67cf00. 00010000:00010000:3.0:1789131340.377786:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131340.397008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.397104:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602688 00000100:00100000:1.0:1789131340.397114:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602688 00000100:00100000:1.0:1789131340.397181:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1789131340.397200:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11739:x1876039893602688:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1789131340.397274:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397291:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397303:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397353:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397361:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397368:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397636:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397646:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397821:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131340.397872:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397883:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397889:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397896:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397902:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.397906:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397913:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397926:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131340.397929:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.397934:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397941:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397952:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397958:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397970:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397981:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.397984:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397990:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.397998:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131340.398001:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.398004:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398009:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398023:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398029:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398035:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398040:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.398043:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398059:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398067:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131340.398069:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.398072:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.398078:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.398271:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11739:x1876039893602688:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1079us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131340.398280:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:2.0:1789131340.445693:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.446296:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893602944 00000100:00100000:1.0:1789131340.446306:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893602944 00000100:00100000:1.0:1789131340.446498:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:1.0:1789131340.446509:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+32:11742:x1876039893602944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131340.446529:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131340.446548:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398e6 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446641:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446656:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446668:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446690:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446698:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.446704:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447050:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879051ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447059:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879051ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447066:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879051ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131340.447075:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789131340.447162:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447170:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447176:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447182:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.447186:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447203:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447214:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131340.447218:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.447222:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447228:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5000/0x9f0de371879051df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447241:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447246:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447253:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447259:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.447262:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447268:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447274:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c47f35d00) 00010000:00010000:1.0:1789131340.447277:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.447279:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447295:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de371879051e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447529:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de371879051d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398e6 expref: 35 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447548:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879051ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398e6 expref: 34 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.447556:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131340.447559:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789131340.447562:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4800, rc 0) 00000100:00100000:1.0:1789131340.447630:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11742:x1876039893602944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1122us (1948us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789131340.447638:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:2.0:1789131340.455120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.455299:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893603072 00000100:00100000:0.0:1789131340.455318:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893603072 00000100:00100000:0.0:1789131340.455404:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1789131340.455424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11742:x1876039893603072:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1789131340.455599:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.455617:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 34 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.455655:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.455690:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 34 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.455704:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 34 pid: 9425 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.455719:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876039910374144:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131340.455968:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789131340.461602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131340.461704:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893603328 00000100:00100000:2.0:1789131340.461714:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893603328 00000100:00100000:2.0:1789131340.461823:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1789131340.461834:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:5590:x1876039893603328:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789131340.462177:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:5590:x1876039893603328:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 344us (584us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789131340.462186:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1789131340.463356:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1876039910374144:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131340.463392:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131340.467196:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.469499:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893603456 00000100:00100000:0.0:1789131340.469514:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893603456 00010000:00010000:0.0:1789131340.469564:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 36 pid: 9425 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.469671:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1789131340.469682:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:2353:x1876039893603456:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131340.469699:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131340.469706:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 36 pid: 9425 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469738:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 36 pid: 9425 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469761:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4c00/0x9f0de371879051a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d1 expref: 36 pid: 9425 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469778:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:0.0:1789131340.469783:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469793:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469800:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.469841:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131340.469914:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:2353:x1876039893603456:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 233us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131340.469922:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00010000:00010000:2.0:1789131340.470150:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470158:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470188:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470206:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470214:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470219:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131340.470224:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470231:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470241:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:2.0:1789131340.470244:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131340.470248:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131340.470253:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879051fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131340.470316:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11742:x1876039893603072:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 14886us (15205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131340.470353:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1789131340.474746:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.474839:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893603712 00000100:00100000:1.0:1789131340.474859:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893603712 00000100:00100000:1.0:1789131340.474924:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1789131340.474934:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+34:11742:x1876039893603712:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131340.476843:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11742:x1876039893603712:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 1902us (2098us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1789131340.476855:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1789131340.595634:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.595748:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893603968 00000100:00100000:0.0:1789131340.595758:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893603968 00000100:00100000:0.0:1789131340.595811:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:0.0:1789131340.595822:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+35:11753:x1876039893603968:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1789131340.595845:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131340.595878:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905202 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398ed expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.595970:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.595985:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.595996:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.596010:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.596028:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.596036:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.597003:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.597028:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.597037:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131340.597048:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1789131340.597666:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.597677:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598221:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598229:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.598233:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598241:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598255:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131340.598258:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.598262:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598268:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598282:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598289:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598294:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598299:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.598302:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598834:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598846:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cd00) 00010000:00010000:0.0:1789131340.598849:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.598923:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598930:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.598989:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905202 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ed expref: 38 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.599004:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ed expref: 37 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.599010:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:0.0:1789131340.599012:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131340.599026:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15e00, rc 0) 00000100:00100000:0.0:1789131340.599659:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:11753:x1876039893603968:12345-192.168.203.52@tcp:101:cat.0 Request processed in 3835us (4031us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1789131340.599669:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:3.0:1789131340.608805:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131340.608894:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893604224 00000100:00100000:2.0:1789131340.608904:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893604224 00000100:00100000:2.0:1789131340.608969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1789131340.608980:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:11753:x1876039893604224:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:2.0:1789131340.609678:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11753:x1876039893604224:12345-192.168.203.52@tcp:35:cat.0 Request processed in 698us (880us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1789131340.609688:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:2.0:1789131340.642713:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.642832:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893604480 00000100:00100000:1.0:1789131340.642843:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893604480 00000100:00100000:1.0:1789131340.642907:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:1.0:1789131340.642946:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11754:x1876039893604480:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:1.0:1789131340.643007:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789131340.643036:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398ed expref: 38 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643072:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879051ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398e6 expref: 37 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643087:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de371879051b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398d8 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643101:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131340.643112:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131340.643146:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643160:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643171:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643185:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643193:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643199:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.643910:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.644181:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.644191:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131340.647912:0:8131:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789131340.648620:0:8131:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352622297432ns, next at 353622292042ns, rc = 0 00010000:00010000:1.0:1789131340.648715:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648730:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648741:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648750:0:8131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648757:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648764:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648787:0:8131:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131340.648808:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648826:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648833:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648840:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131340.648844:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648851:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648862:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35900) 00010000:00010000:1.0:1789131340.648865:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789131340.648869:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648875:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905233 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648896:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648903:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648908:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.648914:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131340.649298:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131340.649319:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.649359:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131340.649362:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.649369:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.649378:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c0c47f35900) 00010000:00010000:3.0:1789131340.649381:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789131340.649384:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.649390:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de3718790523a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.649407:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131340.649409:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131340.649411:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131340.649597:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.649608:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.649620:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131340.649623:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131340.649626:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.649633:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de37187905225 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131340.649649:0:8131:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e9749bf0 reply state 00000000b54f695a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.649658:0:8131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789131340.649772:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+37:11754:x1876039893604480:12345-192.168.203.52@tcp:36:rm.0 Request processed in 6825us (7064us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789131340.649782:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00010000:00010000:0.0:1789131340.654470:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654491:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654529:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654535:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.654540:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654547:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654563:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c47f35d00) 00010000:00010000:0.0:1789131340.654566:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.654570:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.654576:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de3718790522c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.755195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.755596:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893604736 00000100:00100000:0.0:1789131340.755606:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893604736 00000100:00100000:0.0:1789131340.755665:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:0.0:1789131340.755675:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+36:11760:x1876039893604736:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131340.755698:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131340.755719:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905241 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398f4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757599:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757642:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757655:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757677:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757683:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.757690:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131340.758265:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789131340.758473:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758483:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758491:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758521:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758527:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758533:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758545:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131340.758549:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758557:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758568:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131340.758571:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131340.758576:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905248 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131340.758596:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004eb1367e reply state 00000000dc4a9288 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131340.758604:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789131340.758638:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de37187905241 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 39 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758653:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.758660:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131340.758662:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131340.758665:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15c00, rc 0) 00000100:00100000:0.0:1789131340.758735:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:11760:x1876039893604736:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3062us (3561us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789131340.758749:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00010000:00010000:3.0:1789131340.763197:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763216:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763224:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763230:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131340.763235:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763259:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763276:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392cd00) 00010000:00010000:3.0:1789131340.763279:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131340.763284:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.763290:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de3718790524f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131340.770926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.771017:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893604864 00000100:00100000:0.0:1789131340.771025:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893604864 00000100:00100000:0.0:1789131340.771075:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1789131340.771084:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893604864:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1789131340.771102:0:6706:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131340.771117:0:6706:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0398fb expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789131340.771143:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131340.771163:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=352s v=(0 0) 00010000:00010000:0.0:1789131340.771168:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131340.771177:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.771197:0:6706:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 8 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.771211:0:6706:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14c00, rc 0) 00000100:00100000:0.0:1789131340.771271:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2354:x1876039893604864:12345-192.168.203.52@tcp:101:bash.0 Request processed in 187us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131340.771279:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1789131340.774556:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131340.774983:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893604992 00000100:00100000:3.0:1789131340.774992:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893604992 00000100:00100000:3.0:1789131340.775093:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1789131340.775104:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:11760:x1876039893604992:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1789131340.775128:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131340.775145:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039902 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.775172:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.775181:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131340.775185:0:6704:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131340.775191:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.775225:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.775253:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131340.775268:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1876039910374272:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131340.775394:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131340.778624:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6704:1876039910374272:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131340.778661:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.778682:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fc00, rc 0) 00000100:00100000:1.0:1789131340.778736:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:11760:x1876039893604992:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3634us (4190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131340.778757:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1789131340.780071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131340.780238:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893605120 00000100:00100000:3.0:1789131340.780246:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893605120 00010000:00010000:3.0:1789131340.780283:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131340.780359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1789131340.780369:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893605120:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131340.780381:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131340.780404:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.780418:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.780440:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ebe12d/0x9f0de37187905264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398fb expref: 9 pid: 6706 timeout: 452 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.780457:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131340.780471:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131340.780479:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.780489:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131340.780527:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131340.780541:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910374400:192.168.203.52@tcp:105: 00000100:00100000:3.0:1789131340.780606:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131340.788624:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1876039910374400:192.168.203.52@tcp:105: 00010000:00010000:3.0:1789131340.788654:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131340.793815:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131340.793915:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893605120:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 13544us (13845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131340.793927:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1789131340.794067:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893605376 00000100:00100000:0.0:1789131340.794076:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893605376 00000100:00100000:0.0:1789131340.794127:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1789131340.794136:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+38:11760:x1876039893605376:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1789131340.794971:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:11760:x1876039893605376:12345-192.168.203.52@tcp:35:bash.0 Request processed in 832us (1161us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1789131340.794980:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1789131340.989491:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131340.989580:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893605504 00000100:00100000:0.0:1789131340.989590:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893605504 00000100:00100000:0.0:1789131340.989643:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1789131340.989653:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+39:11776:x1876039893605504:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131340.989677:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131340.989696:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905272 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039909 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989775:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989788:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989799:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131340.989860:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1789131340.989864:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131340.989892:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989923:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905272 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039909 expref: 41 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989948:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039909 expref: 40 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131340.989979:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131340.989982:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131340.989986:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131340.990043:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:11776:x1876039893605504:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 391us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131340.990050:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:2.0:1789131340.998263:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131340.998363:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893605760 00000100:00100000:1.0:1789131340.998371:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893605760 00000100:00100000:1.0:1789131340.998433:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1789131340.998442:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+40:11776:x1876039893605760:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131340.998461:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131340.998480:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de37187905280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039910 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.998572:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.998587:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.998599:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131340.998609:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789131340.998725:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de37187905280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039910 expref: 43 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.998743:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039910 expref: 42 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131340.998772:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131340.998775:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131340.998779:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4600, rc 0) 00000100:00100000:1.0:1789131340.999027:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+42:11776:x1876039893605760:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 584us (771us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789131340.999035:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:2.0:1789131341.009807:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.010028:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893605888 00000100:00100000:3.0:1789131341.010038:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893605888 00000100:00100000:3.0:1789131341.010117:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131341.010128:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+42:2353:x1876039893605888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131341.010142:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131341.010165:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4600/0x9f0de37187905287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039910 expref: 42 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.010185:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:3.0:1789131341.010202:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131341.010258:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:2353:x1876039893605888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 133us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.010266:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1789131341.010367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.011223:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606144 00000100:00100000:0.0:1789131341.011231:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606144 00000100:00100000:0.0:1789131341.011277:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:0.0:1789131341.011285:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+41:11776:x1876039893606144:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131341.011313:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.011357:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905295 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039917 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.011447:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.011460:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.011470:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131341.011483:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789131341.011602:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de37187905295 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039917 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.011635:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039917 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.011643:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131341.011646:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789131341.011661:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15200, rc 0) 00000100:00100000:0.0:1789131341.011705:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:11776:x1876039893606144:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 421us (1339us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789131341.011711:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:2.0:1789131341.027427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.029507:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606272 00000100:00100000:3.0:1789131341.029519:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606272 00000100:00100000:3.0:1789131341.029594:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1789131341.029613:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2355:x1876039893606272:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1789131341.029656:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.029675:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.029684:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789131341.029688:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131341.029693:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.029725:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.029739:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 8 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131341.029752:0:8327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910374528:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131341.029840:0:8327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d000 going to sleep for 11 seconds 00000100:00080000:1.0:1789131341.030660:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789131341.040475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.041278:0:8327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8327:1876039910374528:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131341.041319:0:8327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.042516:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606400 00000100:00100000:1.0:1789131341.042526:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606400 00002000:00100000:1.0:1789131341.042577:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c0c74f0a1c0 x1876039893606400/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:302/0 lens 504/0 e 0 to 0 dl 1789131352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131341.042587:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c74f0a1c0 with x1876039893606400 ext(0->8) 00010000:00010000:1.0:1789131341.042595:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 9 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.042610:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 9 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131341.042618:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c74f0a1c0 00000100:00100000:1.0:1789131341.042661:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1789131341.042676:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2353:x1876039893606400:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:1.0:1789131341.043155:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:2353:x1876039893606400:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 483us (2689us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789131341.043164:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:1.0:1789131341.043178:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c0c74f0a1c0 x1876039893606400/t4294967308(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:302/0 lens 504/448 e 0 to 0 dl 1789131352 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131341.043186:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c74f0a1c0 with x1876039893606400 ext(0->8) 00010000:00010000:1.0:1789131341.043193:0:6712:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.043204:0:6712:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131341.043211:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c0c74f0a1c0 00000100:00100000:2.0:1789131341.052509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.052590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606528 00000100:00100000:0.0:1789131341.052599:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606528 00010000:00010000:0.0:1789131341.052634:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131341.052674:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1789131341.052684:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:2353:x1876039893606528:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131341.052698:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789131341.052716:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789131341.052718:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789131341 00002000:00010000:0.0:1789131341.052721:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789131341 00002000:00010000:0.0:1789131341.052723:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789131341 00010000:00010000:0.0:1789131341.052728:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.052742:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.052774:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790526b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039902 expref: 11 pid: 6704 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.052791:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131341.052796:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131341.052802:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.052812:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.052851:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131341.052906:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893606528:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 223us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.052915:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00010000:00010000:1.0:1789131341.053279:0:8327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053288:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053347:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053357:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053365:0:8327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053373:0:8327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131341.053400:0:8327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053417:0:8327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053430:0:8327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.053437:0:8327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de371879052aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.053546:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2355:x1876039893606272:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 23942us (26126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.053554:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1789131341.059789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.059885:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606784 00000100:00100000:3.0:1789131341.059894:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606784 00000100:00100000:3.0:1789131341.059951:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:3.0:1789131341.059961:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+43:11776:x1876039893606784:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1789131341.060021:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039917 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131341.060376:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789131341.060593:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789131341.060911:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789131341.060967:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.060983:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.060991:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.061027:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.061042:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 47 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.061073:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876039910374656:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131341.061272:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c411ca480 going to sleep for 11 seconds 00000100:00100000:0.0:1789131341.068513:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d861c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1876039910374656:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131341.068544:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.070258:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.070384:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893606912 00000100:00100000:0.0:1789131341.070399:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893606912 00010000:00010000:0.0:1789131341.070441:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131341.070476:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1789131341.070486:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+48:2352:x1876039893606912:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131341.070511:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131341.070518:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070531:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070554:0:8473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de37187905256 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398f4 expref: 48 pid: 5845 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070572:0:8473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131341.070577:0:8473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070588:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070596:0:8473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.070627:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131341.070680:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+47:2352:x1876039893606912:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 195us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.070688:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00010000:00010000:2.0:1789131341.070803:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.070811:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131341.070926:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789131341.071127:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789131341.071237:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876039910374784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789131341.071287:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131341.071385:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131341.071658:0:12380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910374784 00000100:00100000:0.0:1789131341.071665:0:12380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910374784 00000100:00100000:0.0:1789131341.071721:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131341.071729:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5848:x1876039910374784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1789131341.071745:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789131341.071807:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5848:x1876039910374784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 79us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.071825:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131341.072046:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876039910374784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789131341.072814:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789131341.072888:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876039910374912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789131341.072931:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131341.072967:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c742c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789131341.073098:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910374912 00000100:00100000:3.0:1789131341.073245:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910374912 00000100:00100000:3.0:1789131341.073291:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131341.073300:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1876039910374912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789131341.073621:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5848:x1876039910374912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 321us (688us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789131341.073630:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131341.075074:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c74ea7c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1876039910374912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789131341.075188:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789131341.075244:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075255:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075263:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075270:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.075287:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075296:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075335:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131341.075339:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789131341.075345:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.075351:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879052b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789131341.075543:0:5848:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789131341.075640:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789131341.075662:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353049339281ns, next at 354049326961ns, rc = 0 00000001:00080000:1.0:1789131341.075669:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789131341.075704:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131341.075708:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789131341.075714:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de3718790529c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039917 expref: 51 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.075821:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493dac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:11776:x1876039893606784:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 15861us (16041us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789131341.075832:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000020:00080000:1.0:1789131341.075837:0:5848:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789131341.079792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.079863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893607040 00000100:00100000:3.0:1789131341.079872:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893607040 00000100:00100000:3.0:1789131341.079928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:3.0:1789131341.079936:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+50:11776:x1876039893607040:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131341.079958:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131341.079978:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879052b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03991e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.080043:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879052b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03991e expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.080055:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879052b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03991e expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.080072:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131341.080075:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789131341.080078:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fe00, rc 0) 00000100:00100000:3.0:1789131341.080240:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:11776:x1876039893607040:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 303us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.080247:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:2.0:1789131341.085596:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.085703:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893607296 00000100:00100000:0.0:1789131341.085712:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893607296 00000100:00100000:0.0:1789131341.085767:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1789131341.085776:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+51:11776:x1876039893607296:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131341.086019:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11776:x1876039893607296:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 244us (430us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789131341.086027:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1789131341.189107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.189207:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893607424 00000100:00100000:1.0:1789131341.189217:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893607424 00000100:00100000:1.0:1789131341.189280:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:1.0:1789131341.189290:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11786:x1876039893607424:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1789131341.189417:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189435:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189447:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189463:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189470:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189477:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189564:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189572:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189579:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789131341.189617:0:8131:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189629:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189645:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189652:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189658:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.189663:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189671:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189682:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131341.189685:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131341.189690:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189696:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de371879052bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189707:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189712:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189718:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189724:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.189730:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189736:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189756:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c47f35400) 00010000:00010000:1.0:1789131341.189759:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131341.189761:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189767:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189782:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189788:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189795:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189799:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.189802:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189807:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189813:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131341.189815:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131341.189823:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.189828:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4000/0x9f0de371879052cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.190156:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11786:x1876039893607424:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 865us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.190164:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:2.0:1789131341.231273:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.231398:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893607680 00000100:00100000:0.0:1789131341.231407:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893607680 00000100:00100000:0.0:1789131341.231457:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:0.0:1789131341.231466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+52:11789:x1876039893607680:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131341.231485:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.231503:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de371879052d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039925 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231568:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231581:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231608:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231623:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231630:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231636:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231748:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de371879052e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231756:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de371879052e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231763:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de371879052e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131341.231773:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789131341.231866:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231873:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231879:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231885:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.231894:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231900:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231912:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131341.231915:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.231920:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231927:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15c00/0x9f0de371879052db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231939:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231945:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231951:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231956:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.231958:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231964:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231970:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131341.231972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.231981:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.231988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15200/0x9f0de371879052e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.232027:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14600/0x9f0de371879052d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039925 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.232041:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de371879052e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039925 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.232048:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.232050:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131341.232052:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14c00, rc 0) 00000100:00100000:0.0:1789131341.232213:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11789:x1876039893607680:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 746us (949us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789131341.232222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1789131341.237438:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.237523:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893607808 00000100:00100000:1.0:1789131341.237531:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893607808 00000100:00100000:1.0:1789131341.237584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:1.0:1789131341.237593:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11789:x1876039893607808:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1789131341.237656:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237673:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237684:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237708:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237715:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237722:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237727:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.237742:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237751:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237763:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131341.237766:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131341.237771:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.237778:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5200/0x9f0de371879052f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.237850:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11789:x1876039893607808:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 257us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.237857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:1.0:1789131341.241176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.241248:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893608064 00000100:00100000:0.0:1789131341.241258:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893608064 00000100:00100000:0.0:1789131341.241347:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1789131341.241358:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+54:11789:x1876039893608064:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131341.241591:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:11789:x1876039893608064:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 220us (410us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1789131341.241600:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000001:00080000:1.0:1789131341.338964:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789131341.338983:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1789131341.338994:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:1.0:1789131341.346496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.346614:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893608320 00000100:00100000:3.0:1789131341.346626:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893608320 00000100:00100000:3.0:1789131341.346693:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:3.0:1789131341.346704:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+55:11799:x1876039893608320:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1789131341.346727:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131341.346730:0:8131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789131341.346757:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14e00/0x9f0de37187905279 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039909 expref: 55 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.346788:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131341.346802:0:8131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131341.346816:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de371879052fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03992c expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.346941:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.346955:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.346965:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131341.346974:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789131341.347103:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de371879052fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03992c expref: 57 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.347403:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03992c expref: 56 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.347412:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131341.347415:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131341.347417:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f800, rc 0) 00000100:00100000:3.0:1789131341.347480:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11799:x1876039893608320:12345-192.168.203.52@tcp:101:bash.0 Request processed in 778us (995us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789131341.347489:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1789131341.352758:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.352906:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893608576 00000100:00100000:3.0:1789131341.352916:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893608576 00000100:00100000:3.0:1789131341.352975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:3.0:1789131341.352986:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11799:x1876039893608576:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1789131341.353046:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789131341.353085:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03992c expref: 56 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.353104:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14c00/0x9f0de371879052e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039925 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.353122:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131341.353127:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131341.353609:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.353624:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.353635:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789131341.353684:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1789131341.353713:0:5844:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004ed19f99 reply state 00000000c440a725 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131341.353721:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789131341.354487:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11799:x1876039893608576:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1498us (1732us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789131341.354497:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000020:00080000:3.0:1789131341.354504:0:5844:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789131341.357677:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357695:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357716:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357722:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.357726:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357734:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357750:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.357753:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.357758:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.357764:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e800/0x9f0de37187905313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.366832:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.367489:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893608704 00000100:00100000:1.0:1789131341.367499:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893608704 00000100:00100000:1.0:1789131341.367563:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1789131341.367574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+56:11799:x1876039893608704:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131341.367600:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131341.367623:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de3718790531a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039933 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367721:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367737:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367749:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131341.367799:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789131341.367805:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131341.367825:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367850:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4800/0x9f0de3718790531a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367868:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.367876:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131341.367880:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131341.367884:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4400, rc 0) 00000100:00100000:1.0:1789131341.367944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11799:x1876039893608704:12345-192.168.203.52@tcp:101:bash.0 Request processed in 372us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.367952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1789131341.372529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.372608:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893608960 00000100:00100000:0.0:1789131341.372618:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893608960 00000100:00100000:0.0:1789131341.372705:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1789131341.372715:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+57:11799:x1876039893608960:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1789131341.372975:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11799:x1876039893608960:12345-192.168.203.52@tcp:35:bash.0 Request processed in 261us (454us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789131341.372983:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:1.0:1789131341.402083:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131341.471154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131341.471487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609088 00000100:00100000:2.0:1789131341.471498:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609088 00000100:00100000:2.0:1789131341.471567:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:2.0:1789131341.471579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+58:11805:x1876039893609088:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131341.471606:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131341.471628:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1c00/0x9f0de37187905328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03993a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471722:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471736:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471748:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131341.471883:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1789131341.471888:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131341.471914:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471942:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1c00/0x9f0de37187905328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03993a expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471961:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03993a expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.471969:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:2.0:1789131341.471972:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131341.471975:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0a00, rc 0) 00000100:00100000:2.0:1789131341.472486:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893609088:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 906us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131341.472495:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:2.0:1789131341.487408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.487494:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609216 00000100:00100000:3.0:1789131341.487504:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609216 00000100:00100000:3.0:1789131341.487567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1789131341.487578:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893609216:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131341.487616:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131341.487637:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039941 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487699:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487714:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487726:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487742:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487750:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487757:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487867:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487876:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487884:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789131341.487916:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789131341.487926:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789131341.487947:0:5844:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487959:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487967:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487974:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487980:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487987:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131341.487991:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.487998:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488010:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:3.0:1789131341.488013:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131341.488017:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488023:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790533d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488035:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488050:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488055:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488060:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131341.488063:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488069:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488076:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c431fa500) 00010000:00010000:3.0:1789131341.488078:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789131341.488081:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488086:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488113:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039941 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488124:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039941 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.488130:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131341.488132:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789131341.488140:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e200, rc 0) 00000100:00100000:3.0:1789131341.488188:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11805:x1876039893609216:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 612us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.488196:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1789131341.497395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.497441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.497504:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609600 00000100:00100000:0.0:1789131341.497514:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609600 00000100:00100000:0.0:1789131341.497577:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1789131341.497602:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:2355:x1876039893609600:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131341.497619:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131341.497642:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de3718790534b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039941 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.497660:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.497665:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131341.497722:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:2355:x1876039893609600:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.497730:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131341.498472:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609472 00000100:00100000:3.0:1789131341.498480:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609472 00000100:00100000:3.0:1789131341.498522:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:3.0:1789131341.498530:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893609472:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131341.498547:0:8131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131341.498565:0:8131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905352 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039948 expref: -99 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.498658:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.498671:0:8131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.498679:0:8131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.498708:0:8131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.498721:0:8131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 60 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131341.498734:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910375040:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131341.498997:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52ea99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131341.505756:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cc000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8131:1876039910375040:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131341.505874:0:8131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.510376:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.510551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609728 00000100:00100000:3.0:1789131341.510561:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609728 00010000:00010000:3.0:1789131341.510603:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 61 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131341.510686:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1789131341.510698:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:2352:x1876039893609728:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131341.510712:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131341.510720:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 61 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.510732:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 61 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.510755:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4400/0x9f0de37187905321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039933 expref: 61 pid: 5846 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.510784:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131341.512961:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.512990:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.512998:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131341.513066:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131341.513136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:2352:x1876039893609728:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 2438us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.513147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00010000:00010000:2.0:1789131341.513247:0:8131:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.513264:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131341.513289:0:8131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789131341.513465:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 61 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.513483:0:8131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 60 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.513490:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:2.0:1789131341.513493:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131341.513496:0:8131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f200, rc 0) 00000100:00100000:2.0:1789131341.513523:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11805:x1876039893609472:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 14993us (16138us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789131341.513530:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:1.0:1789131341.517810:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.518011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893609984 00000100:00100000:0.0:1789131341.518020:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893609984 00000100:00100000:0.0:1789131341.518094:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1789131341.518114:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11805:x1876039893609984:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:0.0:1789131341.518130:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131341.518156:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de371879052b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03991e expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.518176:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.518182:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131341.518242:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893609984:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 139us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.518250:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1789131341.525235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.525364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610112 00000100:00100000:0.0:1789131341.525375:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610112 00000100:00100000:0.0:1789131341.525440:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:0.0:1789131341.525450:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893610112:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1789131341.525575:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.525593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.525609:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131341.525786:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1789131341.526287:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893610112:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 836us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.526297:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:1.0:1789131341.533200:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131341.536688:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610240 00000100:00100000:2.0:1789131341.536704:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610240 00000100:00100000:2.0:1789131341.536946:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:2.0:1789131341.536958:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+59:11805:x1876039893610240:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131341.536979:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131341.537011:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03994f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537070:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537099:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537130:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537143:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537158:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:2.0:1789131341.537161:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789131341.537164:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.537171:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1200, rc 0) 00000100:00100000:2.0:1789131341.537248:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11805:x1876039893610240:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 293us (4059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131341.537256:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1789131341.785735:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910375552:0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.785736:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910375168:0@lo:400:kworker.0 00000100:00100000:1.0:1789131341.785862:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910375296:0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.789364:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131341.789439:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910375680:0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.789487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131341.789545:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910375680 00000100:00100000:2.0:1789131341.789552:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910375680 00000100:00100000:2.0:1789131341.789615:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789131341.789625:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910375680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.789694:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910375680:12345-0@lo:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131341.789702:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789131341.790246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131341.790293:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910375424:0@lo:400:kworker.0 00000100:00100000:3.0:1789131341.790356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131341.790402:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910375168 00000100:00100000:0.0:1789131341.790408:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910375168 00000100:00100000:3.0:1789131341.790417:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910375552 00000100:00100000:3.0:1789131341.790423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910375552 00000100:00100000:0.0:1789131341.790447:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789131341.790456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910375168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131341.790459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910375424 00000100:00100000:3.0:1789131341.790463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910375424 00000100:00100000:3.0:1789131341.790495:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789131341.790507:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131341.790508:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45921050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3307:x1876039910375168:12345-0@lo:400:kworker.0 Request processed in 51us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.790520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789131341.790555:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910375552:12345-0@lo:400:kworker.0 Request processed in 52us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.790562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789131341.790576:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910375424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131341.790616:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910375424:12345-0@lo:400:kworker.0 Request processed in 47us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.791091:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789131341.791136:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910375552:0@lo:400:kworker.0 00000100:00080000:3.0:1789131341.791191:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789131341.791196:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131341.791218:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910375424:0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.791295:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910375680:0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.791339:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910375168:0@lo:400:kworker.0 00000100:00100000:0.0:1789131341.791405:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789131341.792229:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131341.792519:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910375296 00000100:00100000:2.0:1789131341.792526:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910375296 00000100:00100000:2.0:1789131341.792576:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789131341.792585:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910375296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131341.792646:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910375296:12345-0@lo:400:kworker.0 Request processed in 62us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131341.792653:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789131341.793249:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910375296:0@lo:400:kworker.0 00000040:00080000:3.0:1789131341.851723:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131341.851733:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131341.851782:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789131341.851789:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131341.851931:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43def480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910375808:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131341.852079:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52ea9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131341.866661:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.866776:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43def480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910375808:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131341.867948:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610368 00000100:00100000:0.0:1789131341.867958:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610368 00000100:00100000:0.0:1789131341.868020:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:0.0:1789131341.868044:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11807:x1876039893610368:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131341.868084:0:9425:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131341.868202:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11807:x1876039893610368:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 159us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.868211:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1789131341.878410:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.878614:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610496 00000100:00100000:0.0:1789131341.878625:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610496 00000100:00100000:0.0:1789131341.878687:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:0.0:1789131341.878696:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11807:x1876039893610496:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.878778:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.878801:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.878813:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.878979:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.878989:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.878996:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879016:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879041:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879047:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131341.879082:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789131341.879086:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131341.879097:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879107:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879113:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879120:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879126:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.879130:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879138:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879148:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131341.879150:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.879155:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879170:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de37187905375 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879181:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879187:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879193:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879198:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.879201:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879207:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131341.879215:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.879218:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879223:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de3718790537c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879245:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879251:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879261:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879267:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.879269:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879275:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879282:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.879284:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131341.879287:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.879293:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de37187905383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131341.879403:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11807:x1876039893610496:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 707us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.879411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:3.0:1789131341.885131:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.885388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610752 00000100:00100000:0.0:1789131341.885399:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610752 00000100:00100000:0.0:1789131341.885458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:0.0:1789131341.885468:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+60:11807:x1876039893610752:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.885489:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.885509:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de3718790538a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039956 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.885626:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.885642:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.885654:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131341.885668:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789131341.886195:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886205:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886211:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886216:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131341.886220:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886226:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886248:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131341.886250:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131341.886255:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886270:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de37187905391 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886318:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de3718790538a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039956 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131341.886486:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131341.886491:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de3718790538a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039956 expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.886501:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15400, rc 0) 00000100:00100000:0.0:1789131341.886621:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893610752:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1153us (1498us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1789131341.886630:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:2.0:1789131341.899373:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.904198:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893610880 00000100:00100000:0.0:1789131341.904212:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893610880 00000100:00100000:0.0:1789131341.905108:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:0.0:1789131341.905119:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893610880:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131341.905185:0:9425:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131341.905549:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893610880:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 429us (6183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.905557:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:2.0:1789131341.910992:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.912638:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893611136 00000100:00100000:0.0:1789131341.912652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893611136 00000100:00100000:0.0:1789131341.912720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:0.0:1789131341.912743:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893611136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.912764:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.912767:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789131341.912792:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de3718790532f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03993a expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.912812:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131341.913116:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131341.913393:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de3718790539f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03995d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131341.913774:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1789131341.914099:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879053a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.914115:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879053a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.914429:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879053a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.914491:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de3718790539f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03995d expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.914509:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879053a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03995d expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.914517:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392ce00) 00010000:00010000:0.0:1789131341.914519:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131341.914536:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15600, rc 0) 00000100:00100000:0.0:1789131341.914604:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11807:x1876039893611136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1862us (3621us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1789131341.914612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:3.0:1789131341.918988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.920224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893611392 00000100:00100000:0.0:1789131341.920238:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893611392 00000100:00100000:1.0:1789131341.920402:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1789131341.920415:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11807:x1876039893611392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789131341.920482:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131341.920509:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15600/0x9f0de371879053a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03995d expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920599:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392ce00) 00010000:00010000:1.0:1789131341.920612:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789131341.920634:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920647:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920670:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920685:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920707:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920713:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920806:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.920814:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921110:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921117:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.921121:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921128:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921138:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131341.921149:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131341.921152:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921158:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4200/0x9f0de371879053b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921170:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921184:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921190:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921195:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.921198:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921204:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921212:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf7a9b2df (ffff9c0c47f35400) 00010000:00010000:1.0:1789131341.921215:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131341.921217:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.921223:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf7a9b2df bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.921580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c4634e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893611392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1165us (2599us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131341.921589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:2.0:1789131341.927132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.927984:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893611520 00000100:00100000:0.0:1789131341.927994:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893611520 00000100:00100000:0.0:1789131341.928058:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:0.0:1789131341.928067:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+61:11807:x1876039893611520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.928087:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.928108:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de371879053c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039964 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928146:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928160:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928171:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928272:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de371879053c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 63 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928290:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 62 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.928309:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131341.928319:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131341.928347:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15e00, rc 0) 00000100:00100000:0.0:1789131341.928406:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11807:x1876039893611520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 340us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.928414:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:2.0:1789131341.931316:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.931438:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893611776 00000100:00100000:0.0:1789131341.931447:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893611776 00000100:00100000:0.0:1789131341.931503:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:0.0:1789131341.931513:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+62:11807:x1876039893611776:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.931596:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.931614:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.931625:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131341.931899:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1789131341.931909:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353905586568ns, next at 354905584623ns, rc = 0 00000004:00010000:0.0:1789131341.931996:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004935bb8e reply state 00000000d4edcca2 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131341.932005:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131341.932097:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11807:x1876039893611776:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 584us (799us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1789131341.932104:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00010000:00010000:1.0:1789131341.933583:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933598:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933623:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933629:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131341.933634:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933642:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933657:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:1.0:1789131341.933660:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789131341.933665:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.933671:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15a00/0x9f0de371879053d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.938800:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.939002:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893611904 00000100:00100000:1.0:1789131341.939012:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893611904 00000100:00100000:1.0:1789131341.939065:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:1.0:1789131341.939074:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+63:11807:x1876039893611904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131341.939109:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131341.939136:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03996b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.939191:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.939224:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 64 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.939245:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:1.0:1789131341.939248:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131341.939252:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5400, rc 0) 00000100:00100000:1.0:1789131341.939318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11807:x1876039893611904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 244us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.939356:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:2.0:1789131341.946755:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.946953:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893612032 00000100:00100000:1.0:1789131341.946964:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893612032 00000100:00100000:1.0:1789131341.947034:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1789131341.947045:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893612032:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789131341.947381:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2352:x1876039893612032:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 337us (635us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789131341.947388:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:3.0:1789131341.949618:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131341.949733:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.949813:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893612288 00000100:00100000:1.0:1789131341.949822:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893612288 00000100:00100000:1.0:1789131341.949923:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1789131341.949934:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+64:11807:x1876039893612288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131341.950266:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+65:11807:x1876039893612288:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 333us (536us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789131341.950275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1789131341.954890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.955014:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893612544 00000100:00100000:3.0:1789131341.955023:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893612544 00000100:00100000:3.0:1789131341.955084:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:3.0:1789131341.955095:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+65:11807:x1876039893612544:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789131341.955217:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+65:11807:x1876039893612544:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 123us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131341.955225:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1789131341.957788:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.957872:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893612672 00000100:00100000:0.0:1789131341.957881:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893612672 00000100:00100000:0.0:1789131341.957955:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:0.0:1789131341.957965:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+65:11807:x1876039893612672:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131341.957986:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131341.958008:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de371879053de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039972 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958093:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958263:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958275:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131341.958341:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131341.958362:0:5845:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958390:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15400/0x9f0de371879053de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039972 expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958408:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039972 expref: 66 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131341.958417:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131341.958420:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789131341.958423:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:0.0:1789131341.958484:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+66:11807:x1876039893612672:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 520us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.958500:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:0.0:1789131341.962398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.962493:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893612800 00000100:00100000:1.0:1789131341.962515:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893612800 00000100:00100000:1.0:1789131341.962602:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1789131341.962612:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+10:2353:x1876039893612800:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131341.962629:0:8327:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131341.962649:0:8327:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039979 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131341.962674:0:8327:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3fa4e, blocks: 0x1 00010000:00010000:1.0:1789131341.962696:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=353s v=(0 0) 00010000:00010000:1.0:1789131341.962701:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131341.962709:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 11 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.962726:0:8327:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 11 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.962739:0:8327:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4200, rc 0) 00000100:00100000:1.0:1789131341.962798:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:2353:x1876039893612800:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 187us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.962804:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1789131341.967382:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131341.967484:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613056 00000100:00100000:0.0:1789131341.967495:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613056 00000100:00100000:0.0:1789131341.967542:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:0.0:1789131341.967550:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+66:11807:x1876039893613056:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789131341.967660:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+66:11807:x1876039893613056:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131341.967669:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:3.0:1789131341.971907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131341.971991:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613184 00000100:00100000:2.0:1789131341.972001:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613184 00000100:00100000:2.0:1789131341.972056:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1789131341.972066:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:11807:x1876039893613184:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131341.972097:0:12438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131341.972114:0:12438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039980 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.972460:0:12438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 12 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.972472:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131341.972476:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131341.972481:0:12438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 12 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.972515:0:12438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 12 pid: 8327 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.972531:0:12438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 12 pid: 8327 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.972545:0:12438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12438:1876039910375936:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131341.972785:0:12438:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131341.979435:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131341.979537:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613312 00000100:00100000:1.0:1789131341.979547:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613312 00010000:00010000:1.0:1789131341.979588:0:8473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 13 pid: 8327 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.979628:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:1.0:1789131341.979639:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2353:x1876039893613312:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131341.979677:0:8473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131341.979700:0:8473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 13 pid: 8327 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.979714:0:8473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 13 pid: 8327 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.979739:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131341.979744:0:8473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131341.979752:0:8473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 13 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.979762:0:8473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 13 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131341.979800:0:8473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 13 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131341.979814:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910376064:192.168.203.52@tcp:105: 00000100:00100000:1.0:1789131341.979896:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0180 going to sleep for 11 seconds 00010000:00010000:2.0:1789131341.980314:0:12438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075646547/0x9f0de371879053ec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039979 expref: 13 pid: 8327 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131341.980359:0:12438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12438:1876039910375936:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131341.980382:0:12438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 12 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131341.980402:0:12438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0600, rc 0) 00000100:00100000:2.0:1789131341.980436:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45c38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+12:11807:x1876039893613184:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8372us (8537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131341.980444:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1789131341.986038:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112e580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8473:1876039910376064:192.168.203.52@tcp:105: 00010000:00010000:1.0:1789131341.986067:0:8473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131341.986138:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:2353:x1876039893613312:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 6500us (6713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131341.986150:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1789131341.990022:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131341.990102:0:6711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613440 00000100:00100000:3.0:1789131341.990113:0:6711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613440 00002000:00100000:3.0:1789131341.990163:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c0c7a427480 x1876039893613440/t0(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:302/0 lens 504/0 e 0 to 0 dl 1789131352 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131341.990174:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7a427480 with x1876039893613440 ext(0->12) 00002000:00010000:3.0:1789131341.990181:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7a427480 00000100:00100000:3.0:1789131341.990211:0:6711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1789131341.990222:0:6711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+11:2353:x1876039893613440:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789131341.990731:0:6711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2353:x1876039893613440:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 509us (714us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789131341.990749:0:6711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00100000:3.0:1789131341.990757:0:6711:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c0c7a427480 x1876039893613440/t4294967320(0) o4->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:302/0 lens 504/448 e 0 to 0 dl 1789131352 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789131341.990766:0:6711:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7a427480 with x1876039893613440 ext(0->12) 00002000:00010000:3.0:1789131341.990770:0:6711:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7a427480 00000100:00100000:0.0:1789131341.993204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131341.993292:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613568 00000100:00100000:2.0:1789131341.993309:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613568 00000100:00100000:2.0:1789131341.993397:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:2.0:1789131341.993407:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+66:11807:x1876039893613568:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789131342.049382:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+66:11807:x1876039893613568:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 55965us (56175us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131342.049404:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000001:00080000:0.0:1789131342.049551:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1789131342.049559:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1789131342.049596:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c47e4d000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789131342.049601:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c4978b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c47e4d840 00000020:00080000:0.0:1789131342.049606:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c4978bd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c7aa5d800 00000020:00080000:0.0:1789131342.049635:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:0.0:1789131342.049641:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1789131342.049648:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1789131342.049663:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789131342.049685:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c4374fa80 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789131342.049687:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c5fdd4500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c4374f240 00000020:00080000:0.0:1789131342.049690:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c5fdd4200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c7a428c00 00000020:00080000:0.0:1789131342.049733:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789131342.049947:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789131342.050050:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910376192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789131342.050417:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131342.050483:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910376192 00000100:00100000:0.0:1789131342.050490:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910376192 00000100:00100000:0.0:1789131342.050531:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789131342.050540:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910376192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789131342.050566:0:6706:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1789131342.050598:0:6706:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3fa4d, atime: 0x6aa3fa4d, ctime: 0x6aa3fa4d, blocks: 0xb 00010000:00010000:0.0:1789131342.050605:0:6706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.050621:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789131342.050626:0:6706:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131342.050633:0:6706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.050647:0:6706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.050663:0:6706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.050671:0:6706:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.050694:0:6706:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131342.050719:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131342.050728:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.050737:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131342.050742:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.050752:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.050769:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.050776:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000753877db/0x9f0de371879053fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.051100:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131342.051103:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131342.051105:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131342.051607:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910376320:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789131342.051615:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910376448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789131342.051668:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131342.051695:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910376320 00000100:00100000:1.0:1789131342.051702:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910376320 00000100:00100000:2.0:1789131342.051722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131342.051741:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910376448 00000100:00100000:1.0:1789131342.051746:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910376448 00000100:00100000:1.0:1789131342.051769:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789131342.051777:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789131342.051780:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3309:x1876039910376320:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789131342.051790:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3306:x1876039910376448:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:1.0:1789131342.051798:0:8327:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1789131342.051829:0:8327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.051845:0:8327:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 12 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.051852:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789131342.051856:0:8327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789131342.051860:0:8327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.051884:0:8327:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 12 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.051899:0:8327:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 12 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.051928:0:8327:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8327:1876039910376576:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131342.051978:0:8327:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0180 going to sleep for 11 seconds 00002000:00010000:2.0:1789131342.052601:0:12438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789131342.052606:0:12438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789131342 00002000:00010000:2.0:1789131342.052608:0:12438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789131342.052611:0:12438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789131342 -> 1789131342 00002000:00010000:2.0:1789131342.052613:0:12438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789131342.052676:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3306:x1876039910376448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 888us (952us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789131342.052684:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789131342.053285:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910376192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2744us (2866us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789131342.053294:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000004:00080000:1.0:1789131342.053410:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0b4112c3c0/2, rc 0, transno 4294967321 00000100:00100000:1.0:1789131342.053418:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910376448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789131342.053519:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1789131342.053525:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:0.0:1789131342.053544:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c55b4e580, transno 4294967307 00000004:00080000:0.0:1789131342.053564:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:0.0:1789131342.053582:0:3308:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0c7a424b40 x1876039910376192/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789131358 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789131342.053592:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c7a424b40/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789131342.053597:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910376192:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789131342.059985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131342.060025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.060084:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613696 00000100:00100000:3.0:1789131342.060094:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613696 00000100:00100000:2.0:1789131342.060171:0:8327:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8327:1876039910376576:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131342.060173:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1789131342.060189:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2352:x1876039893613696:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1789131342.060201:0:8327:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131342.060272:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893613824 00000100:00100000:0.0:1789131342.060277:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893613824 00010000:00010000:0.0:1789131342.060311:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 14 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131342.060720:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1789131342.060730:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+14:2352:x1876039893613824:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131342.060742:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131342.060748:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 14 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.060762:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 14 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.060786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ec2d7c1/0x9f0de371879051bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398df expref: 14 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.060815:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131342.061592:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789131342.061599:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.061611:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.061646:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131342.061724:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+13:2352:x1876039893613824:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 992us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131342.061734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00010000:00010000:1.0:1789131342.062010:0:8327:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.062020:0:8327:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.062030:0:8327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.062036:0:8327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.062065:0:8327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131342.062146:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131342.062153:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.062163:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131342.062167:0:11193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.062178:0:11193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.062193:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.062201:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4074bf0/0x9f0de37187905401 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8327 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.062236:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131342.062238:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131342.062241:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131342.063641:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3309:x1876039910376320:12345-0@lo:6:osp-syn-1-0.0 Request processed in 11857us (11967us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789131342.063653:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1789131342.063902:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0b4112e580/2, rc 0, transno 4294967322 00000100:00100000:2.0:1789131342.063924:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910376320:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1789131342.119524:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1789131342.119546:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1789131342.119570:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1789131342.119793:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893613696:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 59603us (59813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131342.119805:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1789131342.122384:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131342.122455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614080 00000100:00100000:0.0:1789131342.122463:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614080 00000100:00100000:0.0:1789131342.122533:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:0.0:1789131342.122543:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11807:x1876039893614080:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131342.122721:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131342.122748:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15800/0x9f0de371879053e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039972 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.122767:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131342.122771:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131342.122812:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.122825:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.122836:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131342.123061:0:5845:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fee3a9a6 reply state 000000000c8ca038 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131342.123069:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1789131342.123347:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131342.124030:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:11807:x1876039893614080:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1485us (1650us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789131342.124048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:2.0:1789131342.132694:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:0.0:1789131342.132824:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132836:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132844:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132850:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131342.132855:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132863:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132879:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131342.132882:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131342.132886:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.132910:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14a00/0x9f0de37187905408 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.135760:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614208 00000100:00100000:1.0:1789131342.135774:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614208 00000100:00100000:2.0:1789131342.135948:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1789131342.135959:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893614208:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789131342.137857:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789131342.137865:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789131342 -> 1789131341 00002000:00010000:2.0:1789131342.137867:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789131341 00002000:00010000:2.0:1789131342.137869:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789131342 -> 1789131341 00002000:00010000:2.0:1789131342.137871:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789131342.137932:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893614208:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 1970us (5243us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789131342.137941:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1789131342.141164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.141222:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614464 00000100:00100000:3.0:1789131342.141233:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614464 00000100:00100000:3.0:1789131342.141309:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:3.0:1789131342.141350:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:11807:x1876039893614464:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789131342.141420:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.141437:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 20 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.141446:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.141481:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 20 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.141505:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 20 pid: 9425 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131342.141519:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e930c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910376704:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131342.141608:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789131342.148845:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e930c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910376704:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131342.148895:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131342.151992:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.152204:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614592 00000100:00100000:3.0:1789131342.152214:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614592 00010000:00010000:3.0:1789131342.152258:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 21 pid: 9425 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131342.152312:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1789131342.152359:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:2352:x1876039893614592:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131342.152374:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131342.152381:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 21 pid: 9425 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152395:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 21 pid: 9425 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152418:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e15e00/0x9f0de371879053c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039964 expref: 21 pid: 9425 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152434:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:3.0:1789131342.152440:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152448:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152455:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.152495:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131342.152609:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:2352:x1876039893614592:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 288us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131342.152617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00010000:00010000:0.0:1789131342.152756:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152764:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152789:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152796:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152801:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152806:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131342.152810:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152817:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152826:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:0.0:1789131342.152829:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789131342.152833:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.152850:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790540f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131342.152890:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11807:x1876039893614464:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 11572us (11735us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789131342.152898:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:1.0:1789131342.156224:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131342.156541:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614720 00000100:00100000:2.0:1789131342.156550:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614720 00000100:00100000:2.0:1789131342.156886:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1789131342.156898:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893614720:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789131342.156943:0:12438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.156965:0:12438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 8 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.156973:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789131342.156978:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789131342.156982:0:12438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.157034:0:12438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 8 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.157048:0:12438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 8 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131342.157062:0:12438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12438:1876039910376832:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131342.157278:0:12438:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45256180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131342.162481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.163173:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893614848 00000100:00100000:3.0:1789131342.163182:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893614848 00010000:00010000:3.0:1789131342.163226:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 9 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131342.163259:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1789131342.163268:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893614848:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131342.163283:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131342.163315:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 9 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.163358:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 9 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.163384:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131342.163389:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789131342.163395:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.163404:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.163443:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131342.163492:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+9:2352:x1876039893614848:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 225us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131342.163501:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00010000:00010000:1.0:1789131342.165421:0:12438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc4f8eeb/0x9f0de371879053f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039980 expref: 8 pid: 12438 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.165443:0:12438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12438:1876039910376832:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131342.165465:0:12438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165477:0:12438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165484:0:12438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165515:0:12438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165523:0:12438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165530:0:12438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165558:0:12438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131342.165562:0:12438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165570:0:12438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165717:0:12438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.165726:0:12438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce35c77b/0x9f0de37187905416 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.165859:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893614720:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 8963us (9641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131342.165868:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1789131342.168553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131342.168669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893615104 00000100:00100000:1.0:1789131342.168678:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893615104 00000100:00100000:1.0:1789131342.168723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:1.0:1789131342.168733:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11807:x1876039893615104:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131342.168803:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.168820:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.168848:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.169034:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.169046:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.169055:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.169087:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.169113:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 20 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.169135:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910376960:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131342.169214:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5042ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131342.172758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131342.172884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893615232 00000100:00100000:2.0:1789131342.172892:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893615232 00010000:00010000:2.0:1789131342.172927:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 21 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131342.172966:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:2.0:1789131342.172974:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:2352:x1876039893615232:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131342.172987:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131342.172993:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 21 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.173005:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 21 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.173025:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:2.0:1789131342.173030:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.173050:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.173058:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131342.173075:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131342.173135:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e91e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:2352:x1876039893615232:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 161us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131342.173143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00010000:00010000:1.0:1789131342.174642:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de371879053d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03996b expref: 20 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.174676:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910376960:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131342.174699:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.174710:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.174732:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131342.174909:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789131342.175040:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789131342.175082:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789131342.175441:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876039910377088:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789131342.175498:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131342.175535:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c45f74540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131342.175614:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910377088 00000100:00100000:0.0:1789131342.175622:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910377088 00000100:00100000:0.0:1789131342.175673:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789131342.175682:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876039910377088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789131342.175757:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876039910377088:12345-0@lo:1000:mdt00_002.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131342.175765:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131342.176057:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1789131342.176063:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c55b4de00, transno 4294967315 00000004:00080000:1.0:1789131342.176078:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1789131342.176093:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0b4112c3c0, transno 4294967321 00000100:00100000:1.0:1789131342.176110:0:5846:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9c0b4112e580 x1876039910376320/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789131358 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131342.176285:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876039910377088:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789131342.176804:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789131342.176872:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876039910377216:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789131342.176913:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131342.176933:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5042ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131342.177975:0:12380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910377216 00000100:00100000:0.0:1789131342.177985:0:12380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910377216 00000100:00100000:0.0:1789131342.178039:0:12380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789131342.178050:0:12380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:5846:x1876039910377216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789131342.178272:0:12380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5846:x1876039910377216:12345-0@lo:1000:mdt00_002.0 Request processed in 224us (1358us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789131342.178280:0:12380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789131342.178446:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1876039910377216:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789131342.178482:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178492:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178512:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178519:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.178524:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178533:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178548:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c4392c300) 00010000:00010000:1.0:1789131342.178551:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131342.178556:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178562:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de37187905424 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178605:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178612:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178617:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178622:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.178625:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178640:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131342.178662:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131342.178669:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178680:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178690:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.178723:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.178737:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910377344:192.168.203.52@tcp:105: 00000100:00100000:1.0:1789131342.178808:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42bd1cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131342.182423:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131342.182620:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893615360 00000100:00100000:0.0:1789131342.182630:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893615360 00000100:00100000:0.0:1789131342.182691:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1789131342.182702:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11805:x1876039893615360:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:0.0:1789131342.182824:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+24:11805:x1876039893615360:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131342.182845:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1789131342.184968:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1876039910377344:192.168.203.52@tcp:105: 00010000:00010000:1.0:1789131342.184997:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185007:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74e14800/0x9f0de37187905367 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185043:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185071:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185083:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185093:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185098:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185106:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185112:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.185222:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185234:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185246:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131342.185250:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131342.185253:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de3718790542b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185271:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185284:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185291:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185307:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5800 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.185310:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185316:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185343:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131342.185346:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131342.185350:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.185356:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5800/0x9f0de3718790541d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.185762:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:11807:x1876039893615104:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 17027us (17214us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1789131342.185773:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000020:00080000:1.0:1789131342.185778:0:5846:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789131342.189263:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131342.189272:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131342.189804:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789131342.189813:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789131342.190365:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131342.190446:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131342.190684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893615616 00000100:00100000:2.0:1789131342.190694:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893615616 00000100:00100000:2.0:1789131342.190748:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:2.0:1789131342.190758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:11805:x1876039893615616:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:2.0:1789131342.191092:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789131342.191374:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:11805:x1876039893615616:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 617us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131342.191383:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:3.0:1789131342.192023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893615872 00000100:00100000:3.0:1789131342.192030:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893615872 00000100:00100000:3.0:1789131342.192074:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1789131342.192083:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493db050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+23:11807:x1876039893615872:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789131342.195635:0:5847:0:(mdd_object.c:4024:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789131342.195780:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1789131342.195851:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195868:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195878:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195887:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195900:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195907:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.195928:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789131342.196027:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493db050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:11807:x1876039893615872:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 3941us (5577us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1789131342.196037:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:3.0:1789131342.196043:0:5847:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789131342.196256:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131342.196263:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.196271:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131342.196275:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.196283:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.196307:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c0c431fae00) 00010000:00010000:0.0:1789131342.196311:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789131342.196315:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.196350:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131342.196366:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131342.196368:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131342.196370:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131342.229907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.229994:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616000 00000100:00100000:3.0:1789131342.230004:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616000 00000100:00100000:3.0:1789131342.230069:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:3.0:1789131342.230081:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+25:11809:x1876039893616000:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1789131342.230117:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131342.230148:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039987 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230208:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230222:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230233:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230248:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230270:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230277:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230595:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230607:0:9425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 26 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230617:0:9425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230647:0:9425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 26 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.230662:0:9425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 26 pid: 8131 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131342.230675:0:9425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b43e92580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910377472:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131342.230748:0:9425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131342.234448:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131342.234574:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616256 00000100:00100000:1.0:1789131342.234584:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616256 00000100:00100000:1.0:1789131342.234645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1789131342.234656:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:5589:x1876039893616256:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789131342.234901:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:5589:x1876039893616256:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 247us (461us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789131342.234909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:3.0:1789131342.235361:0:9425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b43e92580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9425:1876039910377472:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131342.235389:0:9425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131342.237708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131342.237789:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616384 00000100:00100000:3.0:1789131342.237812:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616384 00010000:00010000:3.0:1789131342.237849:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 28 pid: 8131 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131342.237890:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1789131342.237900:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:2353:x1876039893616384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131342.237914:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131342.237921:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 28 pid: 8131 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.237935:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 28 pid: 8131 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.237958:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905359 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039948 expref: 28 pid: 8131 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.237974:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131342.237979:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.237987:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.237994:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131342.238029:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131342.238273:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:2353:x1876039893616384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 374us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131342.238292:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00010000:00010000:1.0:1789131342.238538:0:9425:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238547:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131342.238586:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789131342.238591:0:9425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131342.238611:0:9425:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238623:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238633:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238639:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238645:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238662:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.238666:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238684:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238694:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:1.0:1789131342.238697:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131342.238701:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238707:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905440 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238719:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238724:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238729:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238733:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131342.238736:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238742:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238749:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c0c431fa500) 00010000:00010000:1.0:1789131342.238751:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131342.238755:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238774:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238809:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039987 expref: 27 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238822:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039987 expref: 26 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131342.238830:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131342.238832:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131342.238834:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ec00, rc 0) 00000100:00100000:1.0:1789131342.238865:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11809:x1876039893616000:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 8788us (8967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131342.238872:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:3.0:1789131342.297610:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131342.297633:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910377600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131342.297713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131342.297804:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910377600 00000100:00100000:1.0:1789131342.297811:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910377600 00000100:00100000:1.0:1789131342.297864:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789131342.297873:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910377600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131342.297894:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789131342.297944:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43e92580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1876039910377600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131342.297951:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789131342.298032:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910377600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789131342.427093:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131342.930226:0:12934:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789131342.930236:0:12934:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789131342.930286:0:12934:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789131342.930302:0:12934:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789131343.193576:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131343.193585:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131343.193618:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789131343.193624:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789131343.193742:0:12104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7aa59680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910377728:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131343.193844:0:12104:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52cd1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131343.204708:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131343.204805:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616512 00000100:00100000:0.0:1789131343.204814:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616512 00000100:00100000:0.0:1789131343.204873:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:0.0:1789131343.204897:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:11821:x1876039893616512:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131343.204934:0:5846:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131343.205081:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:11821:x1876039893616512:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 186us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131343.205089:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:2.0:1789131343.205771:0:12104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7aa59680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:12104:1876039910377728:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131343.210644:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131343.210747:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616768 00000100:00100000:1.0:1789131343.210757:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616768 00000100:00100000:1.0:1789131343.210818:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:1.0:1789131343.210829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+26:11821:x1876039893616768:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789131343.210850:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131343.210890:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187905455 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03998e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.211005:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de3718790545c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.211020:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de3718790545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.211034:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de3718790545c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131343.211045:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789131343.211467:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5600/0x9f0de37187905455 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03998e expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.211489:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de3718790545c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03998e expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.211498:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131343.211501:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789131343.211505:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4e00, rc 0) 00000100:00100000:1.0:1789131343.211566:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:11821:x1876039893616768:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 739us (932us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1789131343.211589:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:0.0:1789131343.216499:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131343.216599:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893616896 00000100:00100000:2.0:1789131343.216608:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893616896 00000100:00100000:2.0:1789131343.216675:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1789131343.216685:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:2355:x1876039893616896:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131343.216700:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131343.216723:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4e00/0x9f0de3718790545c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03998e expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131343.216755:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:2.0:1789131343.216760:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131343.216851:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:2355:x1876039893616896:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 166us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131343.216859:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1789131343.219010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131343.220685:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617152 00000100:00100000:1.0:1789131343.220699:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617152 00000100:00100000:1.0:1789131343.220805:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:1.0:1789131343.220815:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+27:11821:x1876039893617152:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789131343.220892:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.220911:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.220923:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221122:0:9425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221130:0:9425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221136:0:9425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221143:0:9425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131343.221147:0:9425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221223:0:9425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221255:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131343.221258:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131343.221263:0:9425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131343.221270:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5400/0x9f0de3718790546a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131343.221660:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:11821:x1876039893617152:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 833us (2644us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1789131343.221670:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:0.0:1789131343.225013:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131343.225093:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617408 00000100:00100000:3.0:1789131343.225118:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617408 00000100:00100000:3.0:1789131343.225187:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1789131343.225197:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+28:11821:x1876039893617408:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131343.225461:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:11821:x1876039893617408:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 265us (455us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789131343.225470:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000040:00080000:2.0:1789131343.227183:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131343.227190:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131343.228128:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789131343.228140:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789131343.450145:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131344.475397:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131344.652565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131344.652607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617536 00000100:00100000:0.0:1789131344.652617:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617536 00000100:00100000:0.0:1789131344.652663:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:0.0:1789131344.652673:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893617536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131344.652747:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893617536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131344.652755:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 323 00000100:00100000:0.0:1789131344.656739:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131344.656776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131344.656799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131344.656822:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131344.656847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617664 00000100:00100000:0.0:1789131344.656857:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617664 00000100:00100000:0.0:1789131344.656916:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618048 00000100:00100000:0.0:1789131344.656919:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618048 00000100:00100000:0.0:1789131344.656943:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:0.0:1789131344.656953:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:2353:x1876039893617664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131344.657035:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:2353:x1876039893617664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131344.657043:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:0.0:1789131344.657060:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:0.0:1789131344.657067:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893618048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131344.657091:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2353:x1876039893618048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131344.657097:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:0.0:1789131344.657114:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617920 00000100:00100000:0.0:1789131344.657118:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617920 00000100:00100000:0.0:1789131344.657142:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893617792 00000100:00100000:0.0:1789131344.657144:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893617792 00000100:00100000:0.0:1789131344.657161:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1789131344.657167:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893617920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131344.657192:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893617920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131344.657198:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1789131344.657208:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1789131344.657214:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893617792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131344.657236:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55ac6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893617792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131344.657242:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00080000:0.0:1789131344.657263:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131344.657267:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131344.657269:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789131344.811502:0:12985:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789131344.811511:0:12985:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789131344.811550:0:12985:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789131344.811555:0:12985:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789131345.005653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131345.005693:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618304 00000100:00100000:1.0:1789131345.005701:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618304 00000100:00100000:1.0:1789131345.005752:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:1.0:1789131345.005763:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+29:11841:x1876039893618304:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131345.005783:0:9425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131345.005880:0:9425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de37187905471 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039995 expref: -99 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131345.005974:0:9425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905478 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131345.005988:0:9425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905478 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131345.006008:0:9425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905478 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131345.006019:0:9425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789131345.006449:0:9425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5a00/0x9f0de37187905471 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039995 expref: 32 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131345.006467:0:9425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905478 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039995 expref: 31 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131345.006474:0:9425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:1.0:1789131345.006477:0:9425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789131345.006481:0:9425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5e00, rc 0) 00000100:00100000:1.0:1789131345.006535:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:11841:x1876039893618304:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 775us (891us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789131345.006543:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:1.0:1789131345.016877:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131345.017002:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618432 00000100:00100000:3.0:1789131345.017012:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618432 00000100:00100000:3.0:1789131345.017071:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1789131345.017083:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:11841:x1876039893618432:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1789131345.017147:0:8131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017172:0:8131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017183:0:8131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017208:0:8131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017215:0:8131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017221:0:8131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017227:0:8131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fe00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131345.017230:0:8131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017237:0:8131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017248:0:8131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:3.0:1789131345.017251:0:8131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789131345.017256:0:8131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131345.017262:0:8131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fe00/0x9f0de37187905486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131345.017358:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+31:11841:x1876039893618432:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 277us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131345.017372:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:1.0:1789131345.111226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131345.111364:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618560 00000100:00100000:2.0:1789131345.111375:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618560 00000100:00100000:2.0:1789131345.111425:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1789131345.111435:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2352:x1876039893618560:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1789131345.111454:0:12438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131345.111477:0:12438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001e2a1d9/0x9f0de3718790548d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb03999c expref: -99 pid: 12438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131345.111505:0:12438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3fa4d, atime: 0x6aa3fa4d, ctime: 0x6aa3fa4d, blocks: 0xb 00010000:00010000:2.0:1789131345.111528:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1789131345.111533:0:12438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131345.111545:0:12438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001e2a1d9/0x9f0de3718790548d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03999c expref: 8 pid: 12438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131345.111565:0:12438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001e2a1d9/0x9f0de3718790548d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03999c expref: 8 pid: 12438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131345.111610:0:12438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1c00, rc 0) 00000100:00100000:2.0:1789131345.111668:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2352:x1876039893618560:12345-192.168.203.52@tcp:101:cat.0 Request processed in 234us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131345.111676:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1789131345.116751:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131345.116937:0:6712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618688 00000100:00100000:1.0:1789131345.116947:0:6712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618688 00002000:00100000:1.0:1789131345.116999:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c0c7aa59680 x1876039893618688/t0(0) o3->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:306/0 lens 488/0 e 0 to 0 dl 1789131356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131345.117010:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7aa59680 with x1876039893618688 ext(0->4095) 00002000:00010000:1.0:1789131345.117016:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7aa59680 00000100:00100000:1.0:1789131345.117046:0:6712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1789131345.117056:0:6712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2354:x1876039893618688:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:1.0:1789131345.117366:0:6712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+8:2354:x1876039893618688:12345-192.168.203.52@tcp:3:cat.0 Request processed in 310us (625us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1789131345.117374:0:6712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00002000:00100000:1.0:1789131345.117381:0:6712:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c0c7aa59680 x1876039893618688/t0(0) o3->17aefd58-d436-480c-8fa4-256f2e59c9d4@192.168.203.52@tcp:306/0 lens 488/4536 e 0 to 0 dl 1789131356 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789131345.117389:0:6712:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9c0c7aa59680 with x1876039893618688 ext(0->4095) 00002000:00010000:1.0:1789131345.117393:0:6712:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c0c7aa59680 00000100:00100000:0.0:1789131345.369644:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910377856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131345.369709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131345.369831:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910377856 00000100:00100000:3.0:1789131345.369839:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910377856 00000100:00100000:3.0:1789131345.369891:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789131345.369900:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910377856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131345.369930:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131345.369974:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910377856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131345.369981:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789131345.370019:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910377856:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789131345.370204:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131345.497673:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789131346.493548:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789131346.521525:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131346.905863:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910378240:0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.905932:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131346.906004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789131346.906011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.906036:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131346.906055:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910378624:0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.906081:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131346.906127:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378240 00000100:00100000:1.0:1789131346.906133:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378240 00000100:00100000:1.0:1789131346.906184:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378112 00000100:00100000:1.0:1789131346.906188:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378112 00000100:00100000:1.0:1789131346.906212:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789131346.906221:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.906286:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910378240:12345-0@lo:400:kworker.0 Request processed in 66us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131346.906306:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789131346.906347:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789131346.906368:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.906400:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910378112:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131346.906406:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1789131346.906425:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131346.906460:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910378112:0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.906473:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910378240:0@lo:400:kworker.0 00000100:00100000:2.0:1789131346.906560:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b4112cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910377984:0@lo:400:kworker.0 00000100:00100000:2.0:1789131346.906594:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131346.906626:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910378496:0@lo:400:kworker.0 00000100:00100000:2.0:1789131346.906649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131346.906667:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131346.906673:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910378368:0@lo:400:kworker.0 00000100:00100000:2.0:1789131346.906695:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131346.907533:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378496 00000100:00100000:0.0:1789131346.907541:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378496 00000100:00100000:0.0:1789131346.907602:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789131346.907610:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910378496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131346.907665:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910378496:12345-0@lo:400:kworker.0 Request processed in 57us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131346.907672:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789131346.907693:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378624 00000100:00100000:0.0:1789131346.907696:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378624 00000100:00100000:0.0:1789131346.907721:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378368 00000100:00100000:0.0:1789131346.907724:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378368 00000100:00100000:0.0:1789131346.907741:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789131346.907747:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910378624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131346.907781:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910378624:12345-0@lo:400:kworker.0 Request processed in 34us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131346.907787:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789131346.907797:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789131346.907802:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910378368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131346.907825:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910378368:12345-0@lo:400:kworker.0 Request processed in 23us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131346.907830:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789131346.907863:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789131346.907868:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c7a424b40, transno 4294967310 00000100:00100000:0.0:1789131346.907892:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910378368:0@lo:400:kworker.0 00000100:00100000:0.0:1789131346.907907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910378496:0@lo:400:kworker.0 00000100:00080000:2.0:1789131346.908166:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131346.908171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131346.909206:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910377984 00000100:00100000:1.0:1789131346.909216:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910377984 00000100:00100000:1.0:1789131346.909428:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789131346.909438:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910377984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131346.909515:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910377984:12345-0@lo:400:kworker.0 Request processed in 79us (2920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131346.909523:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:3.0:1789131346.909597:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b4112cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910377984:0@lo:400:kworker.0 00000100:00100000:0.0:1789131346.909711:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910378624:0@lo:400:kworker.0 00000100:00100000:0.0:1789131347.419220:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910378752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131347.419304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131347.419576:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378752 00000100:00100000:1.0:1789131347.419584:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378752 00000100:00100000:1.0:1789131347.419640:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789131347.419650:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910378752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131347.419685:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131347.419730:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1876039910378752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131347.419739:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789131347.419830:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910378752:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1789131347.478156:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000020:00080000:0.0:1789131347.478171:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789131347.478185:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789131347.478208:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c0c45663b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789131347.478214:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c5fdd4f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c45663d80 00000020:00080000:0.0:1789131347.478217:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c0c5fdd4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c0c742b6400 00000020:00080000:0.0:1789131347.478251:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789131347.478471:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:1.0:1789131347.488896:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1789131347.488932:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1789131347.545763:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131348.571730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131349.364353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131349.364453:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893618816 00000100:00100000:2.0:1789131349.364468:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893618816 00000100:00100000:2.0:1789131349.364565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:2.0:1789131349.364579:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11494:x1876039893618816:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789131349.364723:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11494:x1876039893618816:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 149us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131349.364732:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00080000:1.0:1789131349.366591:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131349.371926:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131349.372020:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619072 00000100:00100000:3.0:1789131349.372032:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619072 00000100:00100000:3.0:1789131349.372105:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1789131349.372116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:11494:x1876039893619072:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789131349.372764:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:11494:x1876039893619072:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 646us (848us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789131349.372775:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000040:00080000:2.0:1789131349.401675:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789131349.401688:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789131349.401727:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789131349.401754:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789131349.593540:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131349.732859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131349.733029:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619200 00000100:00100000:2.0:1789131349.733043:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619200 00000100:00080000:1.0:1789131349.733179:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131349.733360:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:2.0:1789131349.733375:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+5:12292:x1876039893619200:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:2.0:1789131349.733405:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131349.733433:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0000/0x9f0de37187905494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0399a3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.733515:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.733533:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.733546:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131349.733821:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131349.733827:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131349.734341:0:5846:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.734382:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0000/0x9f0de37187905494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399a3 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.734404:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399a3 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131349.734415:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:2.0:1789131349.734427:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131349.734432:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0800, rc 0) 00000100:00100000:2.0:1789131349.734559:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ea032118-1b0a-4f07-916a-9ad64f96010c+6:12292:x1876039893619200:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 1187us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131349.734569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:1.0:1789131349.769307:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131349.769391:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131349.769426:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131349.769463:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131349.769476:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619712 00000100:00100000:0.0:1789131349.769491:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619712 00000100:00100000:1.0:1789131349.769494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131349.769522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619456 00000100:00100000:1.0:1789131349.769526:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619456 00000100:00100000:1.0:1789131349.769574:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619840 00000100:00100000:0.0:1789131349.769576:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619584 00000100:00100000:1.0:1789131349.769577:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619840 00000100:00100000:0.0:1789131349.769581:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619584 00000100:00100000:1.0:1789131349.769602:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:1.0:1789131349.769614:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:2354:x1876039893619456:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131349.769624:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1789131349.769635:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b4112f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893619712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131349.769710:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:2354:x1876039893619456:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 98us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131349.769719:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:2.0:1789131349.769731:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619328 00000100:00100000:2.0:1789131349.769737:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619328 00000100:00100000:1.0:1789131349.769742:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:1.0:1789131349.769751:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2354:x1876039893619840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131349.769778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 325 00000100:00100000:2.0:1789131349.769789:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893619328:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131349.769864:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:3.0:1789131349.769879:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893619584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131349.770296:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b4112f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2354:x1876039893619712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 661us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131349.771108:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1789131349.774484:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2354:x1876039893619840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4715us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131349.774505:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:2.0:1789131349.777042:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2354:x1876039893619328:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 7236us (7594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131349.777833:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 325 00000100:00080000:2.0:1789131349.777926:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131349.777934:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789131349.785587:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2354:x1876039893619584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 15693us (16101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131349.785606:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1789131350.489826:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910378880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131350.489941:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131350.490190:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910378880 00000100:00100000:3.0:1789131350.490221:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910378880 00000100:00100000:3.0:1789131350.490342:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789131350.490357:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910378880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131350.490409:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131350.490477:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910378880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131350.490485:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789131350.490599:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910378880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789131350.491101:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789131350.617919:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131351.641681:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131352.026187:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910379008:0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.026213:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910379136:0@lo:400:kworker.0 00000100:00100000:0.0:1789131352.026528:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910379264:0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.027090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131352.028125:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910379648:0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.028190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131352.028287:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910379392:0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.028314:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131352.028484:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379648 00000100:00100000:2.0:1789131352.028492:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379648 00000100:00100000:2.0:1789131352.028547:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379392 00000100:00100000:2.0:1789131352.028551:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379392 00000100:00100000:2.0:1789131352.028587:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789131352.028597:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910379648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.028667:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910379648:12345-0@lo:400:kworker.0 Request processed in 72us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131352.028675:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789131352.028691:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789131352.028697:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910379392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131352.028730:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910379392:12345-0@lo:400:kworker.0 Request processed in 33us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131352.028737:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789131352.028754:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131352.028758:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131352.028793:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910379392:0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.028821:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379136 00000100:00100000:2.0:1789131352.028829:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000100:00100000:1.0:1789131352.028833:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379136 00000004:00080000:2.0:1789131352.028837:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0b4112e580, transno 4294967322 00000004:00080000:2.0:1789131352.028852:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1789131352.028879:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910379648:0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.028907:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789131352.028918:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910379136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.029195:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910379136:12345-0@lo:400:kworker.0 Request processed in 278us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131352.029204:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789131352.029286:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910379136:0@lo:400:kworker.0 00000100:00100000:0.0:1789131352.035498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131352.035594:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379264 00000100:00100000:2.0:1789131352.035611:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379264 00000100:00100000:2.0:1789131352.035697:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789131352.035710:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131352.035818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131352.035865:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910379520:0@lo:400:kworker.0 00000100:00100000:3.0:1789131352.035912:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131352.035950:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379520 00000100:00100000:3.0:1789131352.035956:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379520 00000100:00100000:3.0:1789131352.036005:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789131352.036014:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910379520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131352.036063:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910379520:12345-0@lo:400:kworker.0 Request processed in 50us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131352.036071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789131352.036367:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379008 00000100:00100000:1.0:1789131352.036373:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379008 00000100:00100000:1.0:1789131352.036411:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789131352.036420:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910379008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131352.036441:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910379520:0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.036465:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910379008:12345-0@lo:400:kworker.0 Request processed in 46us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131352.036474:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910379008:0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.036475:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:3.0:1789131352.036531:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131352.043803:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c772c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910379264:12345-0@lo:400:kworker.0 Request processed in 8087us (8299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131352.043820:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1789131352.043979:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910379264:0@lo:400:kworker.0 00000100:00100000:1.0:1789131352.539363:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131352.539384:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910379776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131352.539449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131352.539697:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379776 00000100:00100000:0.0:1789131352.539704:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379776 00000100:00100000:0.0:1789131352.539755:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789131352.539765:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910379776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131352.539797:0:6708:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131352.539857:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910379776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131352.539864:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789131352.540310:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910379776:0@lo:13:osp-pre-1-0.0 00000020:00080000:0.0:1789131352.615582:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1789131352.615629:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1789131352.615681:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1789131352.615695:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1789131352.668085:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131353.336944:0:13190:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 08:55:52 (1789131352) 00010000:00010000:3.0:1789131353.690193:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131354.713649:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131354.898248:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131354.898298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131354.898347:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131354.898373:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131354.898404:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131354.898444:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893619968 00000100:00100000:1.0:1789131354.898459:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893619968 00000100:00100000:1.0:1789131354.898532:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 327 00000100:00100000:1.0:1789131354.898544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893619968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131354.898645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45923450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2352:x1876039893619968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 103us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131354.898655:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 327 00000100:00100000:1.0:1789131354.898697:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620096 00000100:00100000:1.0:1789131354.898702:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620096 00000100:00100000:1.0:1789131354.898763:0:9425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620480 00000100:00100000:1.0:1789131354.898766:0:9425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620480 00000100:00100000:1.0:1789131354.898790:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1789131354.898797:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:2353:x1876039893620096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131354.898835:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:2353:x1876039893620096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131354.898841:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1789131354.898853:0:9425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:1.0:1789131354.898859:0:9425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2353:x1876039893620480:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131354.898883:0:9425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2353:x1876039893620480:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131354.898888:0:9425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:1.0:1789131354.898910:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620352 00000100:00100000:1.0:1789131354.898913:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620352 00000100:00100000:1.0:1789131354.898944:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620224 00000100:00100000:1.0:1789131354.898947:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620224 00000100:00100000:1.0:1789131354.898970:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1789131354.898976:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893620352:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131354.899009:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2353:x1876039893620352:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131354.899015:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1789131354.899043:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:1.0:1789131354.899051:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893620224:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131354.899076:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2353:x1876039893620224:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131354.899094:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00080000:1.0:1789131354.899299:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131354.899304:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789131354.899307:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131355.611803:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131355.611845:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7437d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910379904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131355.611966:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131355.612106:0:6709:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910379904 00000100:00100000:1.0:1789131355.612117:0:6709:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910379904 00000100:00100000:1.0:1789131355.612190:0:6709:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789131355.612212:0:6709:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910379904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131355.612265:0:6709:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131355.612347:0:6709:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74ea7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910379904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131355.612356:0:6709:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789131355.612413:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7437d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910379904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789131355.612644:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789131355.737640:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131356.619007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131356.619861:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620736 00000100:00100000:0.0:1789131356.619877:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620736 00000100:00100000:0.0:1789131356.619980:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1789131356.619994:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+18:12514:x1876039893620736:12345-192.168.203.52@tcp:35:umount.0 00000100:00080000:3.0:1789131356.620788:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131356.624008:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:12514:x1876039893620736:12345-192.168.203.52@tcp:35:umount.0 Request processed in 4002us (4999us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1789131356.624024:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1789131356.632521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131356.632624:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893620992 00000100:00100000:3.0:1789131356.632638:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893620992 00000100:00100000:3.0:1789131356.632726:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1789131356.632738:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+19:12514:x1876039893620992:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:3.0:1789131356.633536:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:12514:x1876039893620992:12345-192.168.203.52@tcp:35:umount.0 Request processed in 794us (1024us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789131356.633548:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1789131356.642924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131356.642999:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893621248 00000100:00100000:0.0:1789131356.643064:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893621248 00000100:00100000:0.0:1789131356.643180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1789131356.643191:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c493d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+20:12514:x1876039893621248:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1789131356.643747:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c493d9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:12514:x1876039893621248:12345-192.168.203.52@tcp:35:umount.0 Request processed in 555us (833us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789131356.643756:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1789131356.648889:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131356.648991:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893621504 00000100:00100000:0.0:1789131356.649014:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893621504 00000100:00100000:0.0:1789131356.649183:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1789131356.649202:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:12514:x1876039893621504:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1789131356.650569:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:12514:x1876039893621504:12345-192.168.203.52@tcp:35:umount.0 Request processed in 1367us (1685us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789131356.650583:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1789131356.658983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131356.659158:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131356.659449:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131356.659862:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131356.659893:0:12438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893622272 00000100:00100000:1.0:1789131356.659904:0:12438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893622272 00000100:00100000:1.0:1789131356.659978:0:12438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:1.0:1789131356.659989:0:12438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+7:2351:x1876039893622272:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:1.0:1789131356.660041:0:12438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904a53 00000020:00010000:1.0:1789131356.660051:0:12438:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0c55d93800: total 0 00000100:00080000:1.0:1789131356.660057:0:12438:0:(import.c:65:import_set_state_nolock()) ffff9c0c55d91800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789131356.660117:0:12438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789131356.660485:0:12438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2351:x1876039893622272:12345-192.168.203.52@tcp:9:umount.0 Request processed in 496us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131356.660495:0:12438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000020:00010000:1.0:1789131356.661046:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0c55d93800: total 0 00010000:00010000:1.0:1789131356.661078:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0c55d93800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1789131356.661148:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c522e52e/0x9f0de37187904def lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ce expref: 4 pid: 6706 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131356.661191:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001e2a1d9/0x9f0de3718790548d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03999c expref: 3 pid: 12438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131356.661218:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0c55d93800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1789131356.661229:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131356.661231:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131356.661233:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131356.661243:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131356.661803:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893621632 00000100:00100000:2.0:1789131356.661813:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893621632 00000100:00100000:2.0:1789131356.661905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893621888 00000100:00100000:2.0:1789131356.661910:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893621888 00000100:00100000:2.0:1789131356.661926:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893621760 00000100:00100000:2.0:1789131356.661928:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893621760 00000100:00100000:2.0:1789131356.661947:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1789131356.661957:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+15:2353:x1876039893621632:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131356.661973:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131356.661988:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031200/0x9f0de37187904472 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039520 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131356.662105:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131356.662157:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+14:2353:x1876039893621632:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 201us (3190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131356.662165:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1789131356.662182:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1789131356.662189:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+13:2353:x1876039893621888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131356.662208:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131356.662218:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceb200/0x9f0de37187904727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f9 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131356.662227:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131356.662247:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+12:2353:x1876039893621888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 59us (3090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131356.662253:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1789131356.662309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1789131356.662316:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2353:x1876039893621760:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789131356.662345:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131356.662362:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8000/0x9f0de3718790443a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0394e8 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131356.662372:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131356.662450:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74f0cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2353:x1876039893621760:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 132us (3000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131356.662458:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1789131356.667835:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131356.667978:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893622400 00000100:00100000:2.0:1789131356.667992:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893622400 00000100:00100000:2.0:1789131356.668209:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1789131356.668222:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+5:2351:x1876039893622400:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:2.0:1789131356.668265:0:6704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879047eb 00000100:00080000:2.0:1789131356.668276:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e90800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131356.668347:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789131356.668711:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:17aefd58-d436-480c-8fa4-256f2e59c9d4+2:2351:x1876039893622400:12345-192.168.203.52@tcp:9:umount.0 Request processed in 491us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131356.668721:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00080000:1.0:1789131356.669133:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789131356.669766:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131356.676188:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131356.676470:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893623424 00000100:00100000:3.0:1789131356.676483:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893623424 00000100:00100000:3.0:1789131356.676573:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:3.0:1789131356.676585:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+22:2351:x1876039893623424:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:3.0:1789131356.676633:0:8131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904448 00000020:00010000:3.0:1789131356.676668:0:8131:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0b41cfc000: total 0 00000100:00080000:3.0:1789131356.676675:0:8131:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cf8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789131356.676707:0:8131:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1789131356.677431:0:11193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0b41cfc000: total 0 00010000:00010000:0.0:1789131356.677489:0:11193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0b41cfc000, canceled 0 locks, left on hash table 13. 00000100:00100000:3.0:1789131356.677528:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:17aefd58-d436-480c-8fa4-256f2e59c9d4+21:2351:x1876039893623424:12345-192.168.203.52@tcp:39:umount.0 Request processed in 942us (1352us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789131356.677540:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00010000:00010000:0.0:1789131356.677554:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131356.677560:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789131356.677572:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebc00/0x9f0de371879047c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039623 expref: 20 pid: 8131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677601:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131356.677604:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131356.677609:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de3718790536e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03994f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677627:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131356.677629:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131356.677634:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187904cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039781 expref: 18 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677648:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:0.0:1789131356.677651:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131356.677654:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cebe00/0x9f0de37187904e51 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397ea expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677669:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c47f35300) 00010000:00010000:0.0:1789131356.677672:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131356.677676:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c414a7c00/0x9f0de3718790476d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03960e expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677695:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131356.677698:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131356.677702:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de3718790544e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039987 expref: 15 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677733:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c0c431fab00) 00010000:00010000:0.0:1789131356.677737:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131356.677741:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c5e00/0x9f0de37187905478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039995 expref: 14 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677760:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131356.677764:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131356.677768:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41cea400/0x9f0de37187904db0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397b9 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677782:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c0c47f35f00) 00010000:00010000:0.0:1789131356.677784:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789131356.677788:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de37187904dda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397c7 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677806:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131356.677808:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131356.677813:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceae00/0x9f0de37187904aae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0396f5 expref: 11 pid: 9425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677829:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c431fac00) 00010000:00010000:0.0:1789131356.677831:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131356.677835:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187904751 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039607 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677852:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131356.677855:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789131356.677868:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b41ceb000/0x9f0de37187904e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0397f1 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677886:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c0c5855b900) 00010000:00010000:0.0:1789131356.677905:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789131356.677910:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742c4a00/0x9f0de3718790514c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0398c3 expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131356.677927:0:11193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0b41cfc000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1789131356.677941:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131356.677944:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131356.677946:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131356.765495:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131357.150573:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910380160:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.150679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131357.150776:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910380672:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.150807:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131357.150867:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131357.150874:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910380288:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.150901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131357.150942:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380672 00000100:00100000:3.0:1789131357.150951:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380672 00000100:00100000:3.0:1789131357.151019:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789131357.151033:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.151093:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910380672:12345-0@lo:400:kworker.0 Request processed in 66us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131357.151102:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789131357.151129:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910380416:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.151158:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910380672:0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.151169:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131357.151216:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789131357.151218:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380416 00000100:00100000:3.0:1789131357.151224:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380416 00000100:00100000:2.0:1789131357.151236:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910380032:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.151255:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789131357.151264:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910380416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.151301:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910380416:12345-0@lo:400:kworker.0 Request processed in 39us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131357.151308:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789131357.151543:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131357.151580:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910380544:0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.151609:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131357.151636:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910380416:0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.151675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380160 00000100:00100000:2.0:1789131357.151679:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380160 00000100:00100000:2.0:1789131357.151711:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380288 00000100:00100000:2.0:1789131357.151715:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380288 00000100:00100000:2.0:1789131357.151735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380544 00000100:00100000:2.0:1789131357.151737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380544 00000100:00100000:2.0:1789131357.151752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789131357.151759:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910380160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.151800:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7437d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910380160:12345-0@lo:400:kworker.0 Request processed in 41us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131357.151806:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789131357.151819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789131357.151825:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910380288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.151854:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910380288:12345-0@lo:400:kworker.0 Request processed in 29us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131357.152533:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789131357.152548:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910380544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131357.152612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910380544:12345-0@lo:400:kworker.0 Request processed in 70us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131357.152619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789131357.152693:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910380544:0@lo:400:kworker.0 00000100:00100000:2.0:1789131357.153109:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:1.0:1789131357.153439:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789131357.153447:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131357.153451:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131357.156553:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380032 00000100:00100000:3.0:1789131357.156573:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380032 00000100:00100000:3.0:1789131357.156674:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789131357.156686:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910380032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.157731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3308:x1876039910380032:12345-0@lo:400:kworker.0 Request processed in 1041us (6451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131357.157744:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789131357.157852:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910380288:0@lo:400:kworker.0 00000100:00100000:3.0:1789131357.157895:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910380160:0@lo:400:kworker.0 00000100:00100000:0.0:1789131357.159552:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910380032:0@lo:400:kworker.0 00000100:00100000:0.0:1789131357.662564:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131357.662952:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131357.664462:0:10566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380800 00000100:00100000:2.0:1789131357.664481:0:10566:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380800 00000100:00100000:2.0:1789131357.664566:0:10566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789131357.664579:0:10566:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789131357.664627:0:10566:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789131357.664733:0:10566:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131357.664743:0:10566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789131357.664809:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7403c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910380800:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789131357.715403:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:1.0:1789131357.715418:0:7662:0:(genops.c:885:class_export_put()) final put ffff9c0c55d93800/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000001:00080000:0.0:1789131357.716135:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1789131357.716167:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000001:00080000:0.0:1789131357.716176:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1789131357.716182:0:5866:0:(genops.c:885:class_export_put()) final put ffff9c0b41cfc000/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:2.0:1789131357.716544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c55d93800/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-OST0001 00000020:00000080:2.0:1789131357.716718:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41cfc000/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-MDT0000 00000020:00000080:2.0:1789131357.716850:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c55d91800 for lustre-OST0001 00000020:00000080:2.0:1789131357.716880:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b41cf8000 for lustre-MDT0000 00010000:00010000:0.0:1789131357.785568:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131358.405651:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131358.405713:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131358.405880:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893623680 00000100:00100000:1.0:1789131358.405895:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893623680 00000100:00100000:1.0:1789131358.405973:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893623552 00000100:00100000:1.0:1789131358.405977:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893623552 00000100:00100000:1.0:1789131358.406039:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1789131358.406050:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+11:2355:x1876039893623680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131358.406072:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131358.406096:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8c00/0x9f0de37187904521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb03955f expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131358.406119:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131358.406205:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+10:2355:x1876039893623680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 155us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131358.406214:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1789131358.406234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1789131358.406241:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+9:2355:x1876039893623552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131358.406249:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131358.406260:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8e00/0x9f0de3718790451a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039535 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131358.406269:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131358.406287:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:2355:x1876039893623552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 48us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131358.406294:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1789131358.419641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131358.419704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131358.419816:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893623808 00000100:00100000:0.0:1789131358.419849:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893623808 00000100:00100000:0.0:1789131358.419936:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1789131358.419948:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+8:2352:x1876039893623808:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131358.419969:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131358.419995:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd600/0x9f0de37187904720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0395f2 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131358.420031:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131358.420114:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+7:2352:x1876039893623808:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 168us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131358.420131:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1789131358.420820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624064 00000100:00100000:2.0:1789131358.420828:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624064 00000100:00100000:2.0:1789131358.420894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:2.0:1789131358.420904:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7474e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+6:2351:x1876039893624064:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:2.0:1789131358.420948:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790452f 00000020:00010000:2.0:1789131358.420958:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0c7a79a000: total 0 00000100:00080000:2.0:1789131358.420964:0:5844:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a79c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131358.420993:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1789131358.421753:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7474e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ea032118-1b0a-4f07-916a-9ad64f96010c+5:2351:x1876039893624064:12345-192.168.203.52@tcp:39:umount.0 Request processed in 845us (2041us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789131358.421765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000020:00010000:2.0:1789131358.421799:0:11193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0c7a79a000: total 0 00010000:00010000:2.0:1789131358.421804:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131358.421847:0:11193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0c7a79a000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789131358.421885:0:11193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bf00) 00010000:00010000:2.0:1789131358.421889:0:11193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131358.421897:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de3718790549b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399a3 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131358.421922:0:11193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0c7a79a000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789131358.421931:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131358.421933:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131358.421935:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131358.422156:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131358.450513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131358.450673:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624320 00000100:00100000:1.0:1789131358.450684:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624320 00000100:00100000:1.0:1789131358.450783:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 329 00000100:00100000:1.0:1789131358.450794:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+7:2351:x1876039893624320:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:1.0:1789131358.451251:0:5839:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904425 00000020:00010000:1.0:1789131358.451273:0:5839:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0b4270e000: total 0 00000100:00080000:1.0:1789131358.451278:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9c0b42709800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789131358.451403:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45920450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41196d9a-43e4-4d8b-a4ec-306ec0de1dfc+3:2351:x1876039893624320:12345-192.168.203.52@tcp:251:umount.0 Request processed in 609us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131358.451412:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 329 00000020:00010000:2.0:1789131358.451496:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0b4270e000: total 0 00010000:00010000:2.0:1789131358.451562:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0b4270e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789131358.451602:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031800/0x9f0de37187904479 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039527 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131358.451620:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0b4270e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789131358.451629:0:5834:0:(genops.c:885:class_export_put()) final put ffff9c0b4270e000/41196d9a-43e4-4d8b-a4ec-306ec0de1dfc 00010000:00010000:2.0:1789131358.451651:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131358.451654:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131358.451656:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789131358.451666:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b4270e000/41196d9a-43e4-4d8b-a4ec-306ec0de1dfc for MGS 00000020:00000080:2.0:1789131358.451705:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b42709800 for MGS 00010000:00010000:1.0:1789131358.812691:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131359.641672:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789131359.641686:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789131359.643848:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789131359.643868:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789131359.833544:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789131360.050147:0:13388:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789131360.073509:0:13388:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789131360.073564:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.073579:0:13388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.073586:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.073599:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.074583:0:13388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789131360.074593:0:13388:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789131360.074626:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789131360.074630:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789131360.074635:0:13388:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789131360.074657:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a7b3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789131360.075699:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910380928:0@lo:39:umount.0 00000100:00100000:0.0:1789131360.075803:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131360.077531:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910380928 00000100:00100000:3.0:1789131360.077546:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910380928 00000100:00100000:3.0:1789131360.077616:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789131360.077639:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876039910380928:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789131360.077669:0:8131:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904234 00000100:00080000:3.0:1789131360.077677:0:8131:0:(import.c:65:import_set_state_nolock()) ffff9c0c42ca3000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789131360.082940:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131360.082953:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.082964:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceaa00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131360.082969:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.082980:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131360.082987:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131360.083005:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789131360.083008:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789131360.083011:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789131360.083084:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.083104:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131360.083137:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.083145:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41ceaa00/0x9f0de371879044db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044e2 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.083159:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131360.083162:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131360.083165:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131360.083205:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789131360.083239:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381056:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131360.083365:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131360.083552:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381056 00000100:00100000:2.0:1789131360.083560:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381056 00000100:00100000:2.0:1789131360.083628:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131360.083641:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3309:x1876039910381056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131360.083654:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131360.083671:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41cea600/0x9f0de371879044e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879044db expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.083684:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131360.083807:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131360.084082:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a67f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3309:x1876039910381056:12345-0@lo:103:ldlm_bl.0 Request processed in 442us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131360.084091:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131360.085952:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7403c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1876039910380928:12345-0@lo:39:umount.0 Request processed in 8304us (10138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131360.085969:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1789131360.085987:0:8131:0:(genops.c:885:class_export_put()) final put ffff9c0c436bf800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789131360.086026:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c436bf800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789131360.086101:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c42ca3000 for lustre-MDT0000 00000100:00080000:0.0:1789131360.086165:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a7b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789131360.086198:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910380928:0@lo:39:umount.0 00010000:00010000:1.0:1789131360.086377:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131360.086967:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131360.086974:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789131360.086982:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789131360.089982:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090007:0:13388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090040:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090047:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090075:0:13388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131360.090083:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090090:0:13388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090096:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090102:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090125:0:13388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789131360.090133:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090140:0:13388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090147:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090159:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131360.090163:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090167:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090185:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131360.090189:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090192:0:13388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789131360.090199:0:13388:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090200:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090207:0:13388:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131360.090209:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090214:0:13388:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131360.090216:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131360.090219:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789131360.090220:0:13388:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.090225:0:13388:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1789131360.090227:0:13388:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789131360.090234:0:13388:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1789131360.090262:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789131360.090267:0:13388:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789131360.090272:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:1.0:1789131360.090277:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:0.0:1789131360.090277:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131360.090283:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1789131360.090292:0:13388:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c0b4270a800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131360.090297:0:13388:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c0c772ac800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:1.0:1789131360.090305:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789131360.090305:0:13388:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c0c7a79a000 ea032118-1b0a-4f07-916a-9ad64f96010c 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131360.090311:0:13388:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c0c52a89a48) has exports, disconnecting them 00010000:00010000:1.0:1789131360.090313:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de371879044e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044f0 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789131360.090334:0:13388:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c0b4270a800), last request at 1789131357 00010000:00010000:1.0:1789131360.090346:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789131360.090350:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090356:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b8600 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131360.090359:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090366:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131360.090372:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131360.090377:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789131360.090379:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1789131360.090381:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1789131360.090395:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090401:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131360.090415:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090444:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414b8600/0x9f0de371879043df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879043e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090458:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131360.090461:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090467:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131360.090471:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090477:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131360.090483:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131360.090488:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789131360.090491:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789131360.090493:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789131360.090508:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090514:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131360.090522:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090528:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187904712 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de37187904719 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.090533:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131360.090552:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131360.090556:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131360.090560:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131360.090563:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131360.090570:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030000 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131360.090576:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131360.090587:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131360.090588:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131360.090607:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131360.090613:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789131360.090616:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789131360.090621:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789131360.090663:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.090670:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131360.090685:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131360.090701:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789131360.090704:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030000/0x9f0de37187904193 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790419a expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131360.090734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131360.090763:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131360.090768:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131360.090788:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131360.090796:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910381312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131360.090803:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131360.090853:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131360.090876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131360.090915:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381184 00000100:00100000:3.0:1789131360.090925:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131360.090926:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381184 00000100:00100000:3.0:1789131360.090941:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910381440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131360.090971:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789131360.090975:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879043a7 00000100:00100000:1.0:1789131360.091006:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381568 00000100:00080000:0.0:1789131360.091006:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0b42709000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789131360.091010:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381568 00000100:00100000:1.0:1789131360.091040:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381312 00000100:00100000:3.0:1789131360.091041:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381440 00000100:00100000:1.0:1789131360.091044:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381312 00000100:00100000:3.0:1789131360.091050:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381440 00000020:00080000:0.0:1789131360.091071:0:13388:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0b4270a800): rc 0 00000020:00000080:0.0:1789131360.091075:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0b4270a800/lustre-MDT0000-lwp-OST0001_UUID 00000100:00100000:1.0:1789131360.091081:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000020:00080000:0.0:1789131360.091089:0:13388:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c0c772ac800), last request at 1789131357 00000100:00100000:1.0:1789131360.091092:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+21:3309:x1876039910381184:12345-0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789131360.091093:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879042ce 00000100:00080000:0.0:1789131360.091100:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0c772ab000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789131360.091108:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00080000:0.0:1789131360.091114:0:13388:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0c772ac800): rc 0 00000020:00000080:0.0:1789131360.091117:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c772ac800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789131360.091125:0:13388:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba05c1db3ae0 00010000:00010000:1.0:1789131360.091129:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b8200/0x9f0de371879044f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879044e9 expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131360.091143:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131360.091146:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789131360.091151:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789131360.091155:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789131360.091188:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789131360.091206:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:42008966-81eb-4eb4-8558-cee0fff8e6d5+20:3309:x1876039910381184:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (516us total) trans 0 rc 0/0 00000100:00080000:0.0:1789131360.092396:0:13388:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789131360.092428:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e72000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789131360.092451:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789131360.092454:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789131360.092466:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789131360.092551:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910381696:0@lo:9:umount.0 00000100:00100000:0.0:1789131360.092614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789131360.092674:0:13388:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789131360.092685:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cff000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789131360.092702:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910381824:0@lo:9:umount.0 00000100:00100000:0.0:1789131360.092726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789131360.092781:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c0c52a89a48) has no exports 00010000:00010000:0.0:1789131360.092825:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789131360.092849:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b4270a800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789131360.092910:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c772ac800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789131360.092935:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b42709000 for lustre-MDT0000 00000020:00000080:0.0:1789131360.092940:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c772ab000 for lustre-MDT0000 00000100:00100000:0.0:1789131360.092990:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381184:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131360.093380:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381696 00000100:00100000:2.0:1789131360.093387:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381696 00000100:00100000:2.0:1789131360.093466:0:8327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381824 00000100:00100000:2.0:1789131360.093470:0:8327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381824 00000100:00100000:2.0:1789131360.093493:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131360.093504:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876039910381696:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789131360.093598:0:8327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904322 00000100:00080000:2.0:1789131360.093607:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e71800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131360.093646:0:8327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789131360.093885:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876039910381696:12345-0@lo:9:umount.0 Request processed in 383us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131360.093894:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789131360.093911:0:8327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789131360.093918:0:8327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876039910381824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789131360.093931:0:8327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904410 00000100:00080000:2.0:1789131360.093937:0:8327:0:(import.c:65:import_set_state_nolock()) ffff9c0c7a5b2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789131360.093956:0:8327:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789131360.094755:0:8327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1876039910381824:12345-0@lo:9:umount.0 Request processed in 834us (2023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131360.094765:0:8327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789131360.094795:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789131360.094799:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789131360.094808:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131360.094815:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131360.094820:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131360.094851:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b41cff000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789131360.094866:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789131360.094869:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131360.094872:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910381824:0@lo:9:umount.0 00000100:00080000:2.0:1789131360.094885:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e72000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789131360.094894:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789131360.094908:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789131360.094911:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910381696:0@lo:9:umount.0 00000100:00100000:1.0:1789131360.095228:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789131360.095259:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789131360.095303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789131360.095347:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+19:3306:x1876039910381312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131360.095370:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131360.095395:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b9000/0x9f0de371879043e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879043df expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.095421:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131360.095471:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+18:3306:x1876039910381312:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (4596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131360.095478:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789131360.095497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131360.095504:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+17:3306:x1876039910381440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131360.095512:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131360.095522:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fd200/0x9f0de37187904719 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904712 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.095532:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131360.095552:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:42008966-81eb-4eb4-8558-cee0fff8e6d5+16:3306:x1876039910381440:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (4581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131360.095558:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131360.096041:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+15:3309:x1876039910381568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131360.096063:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131360.096083:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40031600/0x9f0de3718790419a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904193 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131360.096096:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131360.096138:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42dc2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3309:x1876039910381568:12345-0@lo:103:ldlm_bl.0 Request processed in 866us (5286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131360.096144:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789131360.096679:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910381440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131360.096692:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:42008966-81eb-4eb4-8558-cee0fff8e6d5:3306:1876039910381312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131360.096924:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381568:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789131360.115842:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c0c52a89a48) has no exports 00000020:00000080:1.0:1789131360.197989:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041ee 00000020:00000080:1.0:1789131360.198006:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c52a90800/lustre-QMT0000_UUID 00000020:01000000:1.0:1789131360.198042:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789131360.198868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c52a90800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789131360.198921:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131360.198935:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789131360.198941:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c0c76121a48) has no exports 00000020:00000080:0.0:1789131360.201987:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041e7 00000020:00000080:0.0:1789131360.202015:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c7402f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789131360.202120:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7402f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789131360.202132:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131360.202148:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789131360.202152:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c74f80800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789131360.202156:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c74f80800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789131360.202164:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1789131360.859109:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789131361.808548:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789131361.808562:0:6729:0:(genops.c:885:class_export_put()) final put ffff9c0c81e77000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789131361.808596:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:3.0:1789131361.808599:0:6729:0:(genops.c:885:class_export_put()) final put ffff9c0c43e91800/17aefd58-d436-480c-8fa4-256f2e59c9d4 00000020:00000080:2.0:1789131361.808648:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c81e77000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789131361.808708:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43e91800/17aefd58-d436-480c-8fa4-256f2e59c9d4 for lustre-OST0000 00000020:00000080:2.0:1789131361.808800:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c81e71800 for lustre-OST0000 00000020:00000080:2.0:1789131361.808806:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c43e90800 for lustre-OST0000 00010000:00010000:2.0:1789131361.881737:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131362.265975:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381952:0@lo:400:kworker.0 00000100:00100000:0.0:1789131362.265990:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910382208:0@lo:400:kworker.0 00000100:00100000:2.0:1789131362.266189:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910382080:0@lo:400:kworker.0 00000100:00100000:3.0:1789131362.269030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131362.269393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910381952 00000100:00100000:1.0:1789131362.269405:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910381952 00000100:00100000:1.0:1789131362.269472:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789131362.269484:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3309:x1876039910381952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131362.269565:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c45922050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:42008966-81eb-4eb4-8558-cee0fff8e6d5+14:3309:x1876039910381952:12345-0@lo:400:kworker.0 Request processed in 83us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131362.269574:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789131362.269636:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910381952:0@lo:400:kworker.0 00000100:00100000:0.0:1789131362.274524:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131362.274642:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910382208 00000100:00100000:3.0:1789131362.274654:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910382208 00000100:00100000:3.0:1789131362.274716:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789131362.274725:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1876039910382208:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789131362.274737:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789131362.274784:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131362.274799:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1876039910382208:12345-0@lo:400:kworker.0 Request processed in 73us (284us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789131362.274808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789131362.274828:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910382080 00000100:00100000:3.0:1789131362.274833:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910382080 00000100:00100000:3.0:1789131362.274877:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789131362.274883:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1876039910382080:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789131362.274889:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789131362.274924:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3306:x1876039910382080:12345-0@lo:400:kworker.0 Request processed in 41us (141us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789131362.274930:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1789131362.275036:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789131362.275043:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789131362.275048:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789131362.275359:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789131362.275365:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789131362.275369:0:3307:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789131362.275375:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131362.275379:0:3307:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 183 00000100:00080000:0.0:1789131362.275386:0:3307:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0b4270b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131362.275424:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b42cf0b40 x1876039910382336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131362.275485:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910382208:0@lo:400:kworker.0 00000100:00100000:1.0:1789131362.275895:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910382336:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789131362.275957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131362.276190:0:8131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910382336 00000100:00100000:0.0:1789131362.276197:0:8131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910382336 00000100:00100000:0.0:1789131362.276233:0:8131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789131362.276239:0:8131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876039910382336:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1789131362.276259:0:8131:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789131362.293744:0:8131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b43decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3305:x1876039910382336:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 17489us (17773us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789131362.293765:0:8131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1789131362.293804:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131362.293813:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131362.293818:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910382336:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789131362.302703:0:3306:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131362.302724:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 167 00000100:00080000:2.0:1789131362.302737:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c0b41aeb000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131362.303307:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a63da40 x1876039910382464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131362.303363:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910382080:0@lo:400:kworker.0 00000100:00100000:1.0:1789131362.304014:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910382464:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789131362.304123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131362.304178:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910382464 00000100:00100000:2.0:1789131362.304187:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910382464 00000100:00100000:2.0:1789131362.304244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789131362.304253:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910382464:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1789131362.304274:0:5846:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789131362.304351:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910382464:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 97us (229us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789131362.304378:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1789131362.304695:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131362.304702:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789131362.304706:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910382464:0@lo:38:ptlrpcd_00_00.0 00000001:00100000:0.0:1789131362.831451:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789131362.831462:0:7662:0:(genops.c:885:class_export_put()) final put ffff9c0c7a5b6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789131362.831505:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a5b6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789131362.831573:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7a5b2800 for lustre-OST0001 00000001:00100000:3.0:1789131362.856966:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ea032118-1b0a-4f07-916a-9ad64f96010c 00000001:00080000:3.0:1789131362.856991:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1789131362.856999:0:5866:0:(genops.c:885:class_export_put()) final put ffff9c0c7a79a000/ea032118-1b0a-4f07-916a-9ad64f96010c 00000020:00000080:1.0:1789131362.857192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a79a000/ea032118-1b0a-4f07-916a-9ad64f96010c for lustre-MDT0000 00000020:00000080:1.0:1789131362.857258:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7a79c000 for lustre-MDT0000 00010000:00010000:2.0:1789131362.905663:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131363.929650:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131364.954303:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131365.978118:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789131366.297541:0:13388:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c7a001060 - data ffff9c0c64fba288/ffff9c0c746dd800 00000020:01000000:3.0:1789131366.297678:0:13388:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c7a450240 - data ffff9c0c67b3d948/ffff9c0c42d72800 00000001:00000004:3.0:1789131366.303827:0:13388:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1789131366.396904:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789131366.396912:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789131366.397395:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789131366.397400:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789131366.397812:0:6755:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789131366.397817:0:6755:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789131366.397826:0:6755:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789131366.402271:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789131366.402280:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789131366.402299:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789131366.402300:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789131366.403591:0:7940:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789131366.403597:0:7940:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1789131366.403608:0:7940:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789131366.473600:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041b6 00000020:00000080:0.0:1789131366.473614:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c7402d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789131366.473903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7402d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789131366.476906:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041cb 00000020:00000080:1.0:1789131366.476917:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c74f81000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789131366.476940:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789131366.476956:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131366.476965:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789131366.476969:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c0c52a8b490) has no exports 00000020:00000080:3.0:1789131366.477160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c74f81000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789131366.477262:0:13388:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789131366.477272:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904409 00000020:00000080:1.0:1789131366.477277:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0b41cff800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789131366.477294:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789131366.477299:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131366.477306:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789131366.477309:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c0b41cf4ed8) has no exports 00000020:00000080:1.0:1789131366.477316:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904402 00000020:00000080:1.0:1789131366.477351:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0b41cfa000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789131366.477359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41cff800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789131366.477377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41cfa000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789131366.477680:0:13388:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789131366.477685:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789131366.477689:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789131366.477695:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789131366.477697:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789131366.477737:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131366.477743:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131366.477749:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904314 00000020:00000080:1.0:1789131366.477753:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0b41aec800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789131366.477759:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789131366.477763:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131366.477766:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:3.0:1789131366.477767:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b41cff000 for lustre-OST0001-osc-MDT0000 00000020:00080000:1.0:1789131366.477769:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c0c76123490) has no exports 00000020:00000080:1.0:1789131366.477775:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790430d 00000020:00000080:3.0:1789131366.477777:0:37:0:(genops.c:885:class_export_put()) final put ffff9c0c436ce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789131366.477778:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c81e75800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789131366.477782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c436ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789131366.477789:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789131366.477873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41aec800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789131366.477886:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c81e75800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789131366.478143:0:13388:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789131366.478146:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789131366.478148:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789131366.478152:0:13388:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789131366.478153:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789131366.478199:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131366.478204:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c81e72000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789131366.478206:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789131366.478214:0:37:0:(genops.c:885:class_export_put()) final put ffff9c0b41aed800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789131366.478218:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41aed800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789131366.478224:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131366.478234:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131366.478239:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131366.478242:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c74029000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789131366.478245:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c74029000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1789131366.478251:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131366.481232:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041d2 00000020:00000080:1.0:1789131366.481246:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c74f80000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789131366.481266:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789131366.481272:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131366.481280:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789131366.481284:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c0c52a8ced8) has no exports 00000020:00000080:1.0:1789131366.481312:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131366.481318:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789131366.481339:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879041d9 00000020:00000080:1.0:1789131366.481343:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c74f84000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789131366.481351:0:13388:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43124000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789131366.481354:0:13388:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43124000 3 00000020:01000004:1.0:1789131366.481357:0:13388:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c0c43124000 from lustre-MDT0000 00000020:00000080:1.0:1789131366.481375:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131366.481378:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789131366.481381:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c7402b000/lustre-MDT0000_UUID 00000020:00000080:1.0:1789131366.481457:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7402b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789131366.481470:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789131366.481513:0:13388:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789131366.481518:0:13388:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789131366.481521:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789131366.481524:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131366.481526:0:13388:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789131366.481533:0:13388:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c0c4595a800 42008966-81eb-4eb4-8558-cee0fff8e6d5 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131366.481538:0:13388:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c0c492c4ed8) has exports, disconnecting them 00000020:00080000:1.0:1789131366.481555:0:13388:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c0c4595a800), last request at 1789131139 00000020:00000080:1.0:1789131366.481570:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904170 00000020:00010000:1.0:1789131366.481574:0:13388:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c0c4595a800: total 2 00000100:00080000:1.0:1789131366.481578:0:13388:0:(import.c:65:import_set_state_nolock()) ffff9c0c45959000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789131366.481599:0:13388:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0c4595a800): rc 0 00000020:00080000:1.0:1789131366.481603:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c0c492c4ed8) has no exports 00000100:00100000:1.0:1789131366.481659:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c0c5fc69200:5839] 2 exiting: rc = 0 00000100:00100000:3.0:1789131366.481777:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c0c5fc69000:5838] 1 exiting: rc = 0 00000020:00000080:3.0:1789131366.481816:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c74f80000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789131366.481821:0:37:0:(genops.c:885:class_export_put()) final put ffff9c0c7402d800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789131366.481823:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7402d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789131366.481827:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:1.0:1789131366.481879:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c0c45000600:5837] 0 exiting: rc = 1 00000020:00000080:3.0:1789131366.482028:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c74f84000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1789131366.482049:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482057:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482063:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482070:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482076:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482082:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482087:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482093:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482099:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482104:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482110:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482115:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.482121:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484380:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484577:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484584:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484591:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484597:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484604:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484610:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484617:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484623:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484630:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484635:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484641:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484664:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484670:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484676:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484682:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484688:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484693:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484699:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484704:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484710:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484715:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484721:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484726:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484731:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484738:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484743:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484749:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484754:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484760:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484765:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484771:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.484776:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485254:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485261:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485267:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485273:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485279:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485285:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485290:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:2.0:1789131366.485297:0:11193:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c0c4595a800: total 0 00000100:00100000:1.0:1789131366.485297:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485304:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485310:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485315:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485508:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485519:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485525:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485542:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485550:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485559:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.485566:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1789131366.487814:0:11193:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c0c4595a800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1789131366.487858:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceb600/0x9f0de371879044b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879044b1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487877:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40030800/0x9f0de37187904487 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904480 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487887:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b9800/0x9f0de371879044c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879044bf expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487897:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c40030a00/0x9f0de37187904495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de3718790448e expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487919:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceb800/0x9f0de3718790470b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904704 expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487939:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414b9c00/0x9f0de37187904281 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de3718790427a expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487953:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c413fc600/0x9f0de371879046fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de371879046f6 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487964:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c414a6e00/0x9f0de3718790450c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9f0de37187904505 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131366.487978:0:11193:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c0c4595a800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1789131366.487992:0:11193:0:(genops.c:885:class_export_put()) final put ffff9c0c4595a800/42008966-81eb-4eb4-8558-cee0fff8e6d5 00010000:00010000:3.0:1789131366.488012:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131366.488014:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131366.488016:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789131366.488028:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c4595a800/42008966-81eb-4eb4-8558-cee0fff8e6d5 for MGS 00000020:00000080:3.0:1789131366.488059:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c45959000 for MGS 20000000:01000000:1.0:1789131366.492668:0:13388:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789131366.492675:0:13388:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789131366.496168:0:13388:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c74d6d960 - data ffff9c0c6ff42000/ffff9c0c49374000 00000020:01000000:3.0:1789131366.508121:0:13388:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c458344e0 - data ffff9c0c4221c1b0/ffff9c0c4500b800 00000020:00000080:3.0:1789131366.508888:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790415b 00000020:00000080:3.0:1789131366.508897:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c5fce5000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789131366.509839:0:13388:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43124000 from MGS, refs=2 00000020:01000004:3.0:1789131366.509845:0:13388:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43124000 2 00000020:01000004:3.0:1789131366.509848:0:13388:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c0c43124000 from MGS 00000020:00000080:3.0:1789131366.509876:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131366.509885:0:13388:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789131366.509889:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c5fce4000/MGS 00000020:00000080:3.0:1789131366.509892:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c5fce4000/MGS for MGS 00000020:01000000:3.0:1789131366.509900:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789131366.510037:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789131366.510042:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789131366.510048:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789131366.510055:0:13388:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c0c7a7b7000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789131366.510062:0:13388:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c0c76124ed8) has exports, disconnecting them 00000020:00080000:3.0:1789131366.510066:0:13388:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c0c7a7b7000), last request at 1789131140 00000020:00000080:3.0:1789131366.510070:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904226 00000020:00080000:3.0:1789131366.510083:0:13388:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0c7a7b7000): rc 0 00000020:00000080:3.0:1789131366.510089:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c7a7b7000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789131366.510811:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c5fce5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789131366.510824:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a7b7000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789131366.521396:0:13388:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789131366.521405:0:13388:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131366.521409:0:13388:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789131366.521416:0:13388:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789131366.521551:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c7a7b3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789131366.521707:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131366.521715:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789131366.521732:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c76128800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789131366.521735:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c76128800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789131366.521749:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789131366.521812:0:13388:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43124000 1 00000020:00000080:0.0:1789131366.521818:0:13388:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790414d 00000020:00000080:0.0:1789131366.521824:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c5fce2000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789131366.521840:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789131366.521845:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131366.521849:0:13388:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789131366.521853:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c0c43721a48) has no exports 00000020:00000080:1.0:1789131366.522082:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c5fce2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789131366.585845:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131366.585859:0:13388:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789131366.585865:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c43127800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789131366.585870:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43127800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789131366.585880:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789131366.586012:0:13388:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c0c43122800 00000020:01000000:0.0:1789131366.586035:0:13388:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789131366.586040:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131366.586044:0:13388:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789131366.586047:0:13388:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c0c52a88000) has no exports 00000100:00100000:0.0:1789131366.586157:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c0c45007200:5844] 0 exiting: rc = 1 00000100:00100000:0.0:1789131366.586432:0:8131:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c0c7a8e0c00:8131] 3 exiting: rc = 0 00000100:00100000:3.0:1789131366.589888:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c0c45007600:5845] 1 exiting: rc = 0 00000100:00100000:2.0:1789131366.591182:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c0c45007a00:5846] 2 exiting: rc = 0 00000100:00100000:1.0:1789131366.591576:0:9425:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c0b422d7600:9425] 4 exiting: rc = 0 00000100:00100000:0.0:1789131366.591970:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.591979:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.591985:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.591991:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.591996:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.592001:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.592007:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.592012:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.592017:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.592023:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597489:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597506:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597512:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597517:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597522:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597527:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597532:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597537:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597543:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597548:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597553:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597557:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597562:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597567:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597572:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597577:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597582:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597804:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597812:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597818:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597823:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597828:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597834:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597839:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597845:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597851:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597857:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597863:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597868:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597873:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597879:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597884:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597890:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597895:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597901:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597923:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.597999:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598007:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598013:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598018:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598024:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598029:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598034:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598039:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598044:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598050:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598055:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598061:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598076:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598082:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598096:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598102:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598107:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.598113:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.604578:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c0c45007e00:5848] 1 exiting: rc = 0 00000100:00100000:3.0:1789131366.605293:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c0c45006400:5847] 0 exiting: rc = 1 00000100:00100000:0.0:1789131366.605676:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605687:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605693:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605698:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605703:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605709:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605717:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605724:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605730:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605736:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605743:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605749:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605756:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605761:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605766:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605784:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605790:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605795:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605800:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605806:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605811:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605816:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605822:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605828:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605833:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605839:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605844:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605849:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605854:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605859:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605864:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605869:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605874:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605879:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605884:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605889:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605894:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605900:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605905:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605910:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605915:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605920:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605938:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605944:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605949:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605954:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605959:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605965:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605971:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605976:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605988:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605993:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.605998:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606003:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606008:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606014:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606019:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606023:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606028:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606033:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606038:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606044:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606049:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.606055:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.607462:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c0c504c3200:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1789131366.607617:0:12380:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c0c4985c600:12380] 2 exiting: rc = 0 00000100:00100000:3.0:1789131366.607893:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c0c42db5000:5849] 0 exiting: rc = 1 00000100:00100000:0.0:1789131366.608277:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608284:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608290:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608296:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608303:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608309:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608316:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608349:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608368:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608375:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608381:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608388:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608393:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608400:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608406:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608411:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608418:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608426:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608432:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608438:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608470:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608477:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608483:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608489:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608498:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608505:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608511:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608517:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608523:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608528:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608534:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608539:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608559:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608567:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608573:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608579:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608585:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608590:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608596:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608602:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608608:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608615:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608620:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608626:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608656:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608772:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608779:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608784:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608791:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608796:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608802:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608808:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608814:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608820:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608826:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608840:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608859:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608865:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608872:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608878:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608886:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608893:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608898:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.608904:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621462:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c0c504c3a00:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789131366.621564:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c0c504c2000:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1789131366.621624:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621778:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621788:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621796:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621802:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621808:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621814:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621821:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621827:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621834:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621840:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621847:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621853:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621860:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621866:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621873:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621879:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621885:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621892:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621898:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621904:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.621910:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622010:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622017:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622023:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622029:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622035:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622042:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622048:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622055:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622061:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622283:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622293:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622300:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622307:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622312:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622318:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622353:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622359:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622363:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622368:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622373:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622378:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622384:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622388:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622393:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622398:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622402:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622407:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622412:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622417:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622422:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622427:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622431:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622436:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622441:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622446:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622460:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622465:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622470:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622474:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622478:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622483:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.622487:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.623435:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c0c42db7800:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1789131366.623576:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c0c50d4e400:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1789131366.623625:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623632:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623649:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623655:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623767:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623775:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623780:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623785:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623790:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623795:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623800:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623804:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623809:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623814:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623819:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623824:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623829:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623834:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623839:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623844:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623849:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623853:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623858:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623862:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623867:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623873:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623878:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623893:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623897:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623903:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623907:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623911:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623916:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623920:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623925:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623942:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623947:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623953:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623958:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623963:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623969:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623974:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623979:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623984:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623989:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623994:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.623999:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624004:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624009:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624013:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624018:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624022:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624027:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624032:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624036:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624041:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624045:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624050:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624055:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624060:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624065:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624070:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624083:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624272:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.624788:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c0c42db7000:5855] 0 exiting: rc = 1 00000100:00100000:1.0:1789131366.624918:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c0c45831400:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789131366.624977:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624983:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624988:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624993:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.624998:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625004:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625009:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625014:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625019:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625024:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625029:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625034:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625039:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625045:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625049:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625054:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625059:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625064:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625070:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625077:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625083:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625167:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625241:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625249:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625255:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625260:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625265:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625270:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625275:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625280:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625285:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625290:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625306:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625311:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625316:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625437:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625447:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625459:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625470:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625476:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625481:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625486:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625491:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625591:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625599:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625604:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625610:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625614:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625620:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625624:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625629:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625748:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625754:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625759:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625764:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625768:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625773:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625778:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625783:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625788:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625792:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625798:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625803:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.625807:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789131366.627079:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c0c42db7400:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1789131366.627804:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c0c45830800:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1789131366.628264:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c0c45831800:5859] 2 exiting: rc = 0 00000100:00100000:0.0:1789131366.628383:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628391:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628397:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628402:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628408:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628413:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628419:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628425:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628430:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628435:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628441:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628447:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628452:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628458:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628463:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628469:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628474:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628480:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628496:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628502:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628507:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628525:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628531:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628537:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628542:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628547:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628553:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628559:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628565:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628570:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628576:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628581:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628586:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628591:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628597:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628603:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628609:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628614:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628620:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628625:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628630:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628789:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628811:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628817:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628822:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628828:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628834:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628840:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628845:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628851:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628856:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628861:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628867:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628871:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628876:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628882:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628896:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628902:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628908:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628913:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628918:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628922:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628937:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131366.628950:0:13388:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789131366.639387:0:13388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131366.639401:0:13388:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789131366.639407:0:13388:0:(genops.c:885:class_export_put()) final put ffff9c0c436ba800/MDS_uuid 00000020:00000080:0.0:1789131366.639411:0:13388:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c436ba800/MDS_uuid for MDS 00000020:01000000:0.0:1789131366.639417:0:13388:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789131366.639552:0:13388:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1789131367.003402:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789131367.386241:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789131367.386247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789131367.386251:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131367.386259:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1789131367.386264:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789131367.386271:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c0b41aeb000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131367.386297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b42cf30c0 x1876039910382720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131367.386313:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789131367.386316:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789131367.386318:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131367.386339:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 374 00000100:00080000:0.0:1789131367.386341:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789131367.386346:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0b4270b800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131367.386357:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b42cf2d00 x1876039910382848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131367.386392:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131367.386409:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910382592:0@lo:400:kworker.0 00000400:00000100:0.0:1789131367.386471:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876039910382592 offset 0 length 224: 4 00000100:00100000:0.0:1789131367.386529:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910382720:0@lo:38:kworker.0 00000400:00000100:0.0:1789131367.386554:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039910382720 offset 0 length 520: 4 00000100:00100000:0.0:1789131367.386567:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910382848:0@lo:38:kworker.0 00000400:00000100:0.0:1789131367.386586:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876039910382848 offset 0 length 520: 4 00010000:00010000:2.0:1789131368.031770:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131369.053363:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789131369.596451:0:13542:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789131369.632313:0:13542:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789131369.632407:0:13542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.632425:0:13542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.632433:0:13542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.632441:0:13542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.632467:0:13542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789131369.632474:0:13542:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789131369.632504:0:13542:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131369.632520:0:13542:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0b42cf30c0 x1876039910382720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131369.632535:0:13542:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789131369.632570:0:13542:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789131369.632572:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131369.632581:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1789131369.632585:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910382720:0@lo:38:kworker.0 00010000:00010000:3.0:1789131369.632618:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131369.632626:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131369.632635:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40031e00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131369.632640:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131369.632649:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131369.632658:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131369.632664:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789131369.632666:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789131369.632669:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789131369.632737:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131369.632745:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131369.632771:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131369.632779:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40031e00/0x9f0de371879044b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044b8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131369.632792:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131369.632794:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131369.632796:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131369.632804:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131369.632821:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910382976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131369.632903:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131369.632979:0:8473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910382976 00000100:00100000:3.0:1789131369.632988:0:8473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910382976 00000100:00100000:3.0:1789131369.633033:0:8473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789131369.633041:0:8473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1876039910382976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789131369.633049:0:8473:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131369 with bad export cookie 11461066703472968048 00000100:00080000:0.0:1789131369.641079:0:13542:0:(import.c:65:import_set_state_nolock()) ffff9c0b41aeb000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789131369.641110:0:13542:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131369.641129:0:13542:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0b42cf30c0 x1876039910382720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131382 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131369.641145:0:13542:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789131369.641151:0:13542:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789131369.649174:0:13542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649199:0:13542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649207:0:13542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649214:0:13542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649242:0:13542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131369.649251:0:13542:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649258:0:13542:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649265:0:13542:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649271:0:13542:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131369.649294:0:13542:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789131369.649300:0:13542:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789131369.649370:0:13542:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789131369.649376:0:13542:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789131369.649383:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131369.649390:0:13542:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789131369.649395:0:13542:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c0c772b4ed8) has no exports 00000020:00080000:1.0:1789131369.649649:0:13542:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c0c772b4ed8) has no exports 00010000:00010000:0.0:1789131369.650744:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131369.650759:0:11193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.650770:0:11193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c414b9400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131369.650775:0:11193:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.650785:0:11193:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131369.650793:0:11193:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131369.650799:0:11193:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131369.650802:0:11193:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789131369.650804:0:11193:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789131369.650860:0:11193:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.650867:0:11193:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789131369.650933:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131369.650942:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131369.650949:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14200 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:2.0:1789131369.650952:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131369.650960:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789131369.650967:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131369.650972:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789131369.650974:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789131369.650977:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789131369.651007:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131369.651014:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131369.651628:0:11193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.651653:0:11193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414b9400/0x9f0de371879044bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de371879044c6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131369.651673:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131369.651675:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131369.651677:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131369.652979:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910383232:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131369.653083:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131369.653150:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789131369.653157:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910383104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131369.653181:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131369.653221:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383232 00000100:00100000:0.0:1789131369.653230:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383232 00000100:00100000:0.0:1789131369.653270:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383104 00000100:00100000:0.0:1789131369.653272:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383104 00000100:00100000:0.0:1789131369.653284:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789131369.653304:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1876039910383232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789131369.653312:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131369 with bad export cookie 11461066703472968048 00000100:00100000:0.0:1789131369.653389:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1876039910383232:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (306us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789131369.653397:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789131369.653416:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131369.653420:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1876039910383104:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789131369.653424:0:5830:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789131369 with bad export cookie 11461066703472968048 00000100:00100000:0.0:1789131369.653449:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3307:x1876039910383104:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (267us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789131369.653473:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789131369.653511:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789131369.653516:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9c0c5fce6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789131369.653521:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:01000000:1.0:1789131369.658739:0:13542:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c7a001000 - data ffff9c0c6798b870/ffff9c0c746dd000 00000020:01000000:1.0:1789131369.658954:0:13542:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c47e231e0 - data ffff9c0c6798bbd0/ffff9c0b41140000 00010000:00010000:2.0:1789131369.659924:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131369.659943:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14200/0x9f0de37187904704 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9f0de3718790470b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131369.659965:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131369.659968:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131369.659971:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131369.666790:0:8473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3308:x1876039910382976:12345-0@lo:103:ldlm_bl.0 Request processed in 33740us (33879us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789131369.666807:0:8473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789131369.667662:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789131369.684156:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789131369.684164:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789131369.684179:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0b42cf21c0 x1876039910382592/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789131383 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131369.684219:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0c7a63de00 x1876039910382976/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131385 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131369.684232:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0c7a426d00 x1876039910383232/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131385 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131369.684241:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0b42cf30c0 x1876039910383104/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789131385 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789131369.684251:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789131369.684256:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789131369.684257:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789131369.684316:0:3308:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c0c5fce6000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:2.0:1789131369.684356:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:42008966-81eb-4eb4-8558-cee0fff8e6d5:3308:1876039910382976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131369.684582:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:42008966-81eb-4eb4-8558-cee0fff8e6d5:3309:1876039910382592:0@lo:400:kworker.0 00000100:00080000:0.0:1789131369.684805:0:3307:0:(import.c:65:import_set_state_nolock()) ffff9c0c5fce6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789131369.684812:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 151 00000100:00080000:0.0:1789131369.684824:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9c0c5fce6000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1789131369.694241:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a424f00 x1876039910383360/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131369.694336:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910383232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131369.694376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:42008966-81eb-4eb4-8558-cee0fff8e6d5:3307:1876039910383104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131369.695260:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42008966-81eb-4eb4-8558-cee0fff8e6d5:3305:1876039910383360:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789131369.695361:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876039910383360 offset 0 length 520: 4 00100000:10000000:0.0:1789131369.714743:0:13542:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789131369.805669:0:13542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de3718790429d 00000020:00000080:1.0:1789131369.805756:0:13542:0:(genops.c:885:class_export_put()) final put ffff9c0c772ad000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789131369.805813:0:13542:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43172800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789131369.805818:0:13542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43172800 2 00000020:01000004:1.0:1789131369.805822:0:13542:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c0c43172800 from lustre-OST0000 00000020:00000080:1.0:1789131369.805853:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789131369.805866:0:13542:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789131369.805869:0:13542:0:(genops.c:885:class_export_put()) final put ffff9c0c772a8000/lustre-OST0000_UUID 00000020:00000080:1.0:1789131369.805873:0:13542:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c772a8000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789131369.805884:0:13542:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789131369.805950:0:13542:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789131369.805956:0:13542:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789131369.805961:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789131369.805967:0:13542:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789131369.805976:0:13542:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c0b41aed000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789131369.805982:0:13542:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9c0c76120000) has exports, disconnecting them 00000020:00080000:1.0:1789131369.805988:0:13542:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c0b41aed000), last request at 1789131155 00000020:00000080:1.0:1789131369.805993:0:13542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879042c7 00000020:00080000:1.0:1789131369.806003:0:13542:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0b41aed000): rc 0 00000020:00000080:1.0:1789131369.806008:0:13542:0:(genops.c:885:class_export_put()) final put ffff9c0b41aed000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789131369.806086:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c772ad000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789131369.807214:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b41aed000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789131369.807401:0:13542:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789131369.807407:0:13542:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131369.807412:0:13542:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789131369.807419:0:13542:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789131369.807595:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789131369.807602:0:13542:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789131369.807608:0:13542:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43172800 1 00000020:00000080:2.0:1789131369.807613:0:13542:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904257 00000020:00000080:2.0:1789131369.807619:0:13542:0:(genops.c:885:class_export_put()) final put ffff9c0c43176000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789131369.807640:0:13542:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789131369.807645:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131369.807650:0:13542:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789131369.807654:0:13542:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c0c492c3490) has no exports 00000020:00000080:3.0:1789131369.807764:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b41aeb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789131369.807773:0:37:0:(genops.c:885:class_export_put()) final put ffff9c0c43686800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789131369.807775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43686800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789131369.807790:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789131369.807858:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43176000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789131369.823133:0:13542:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131369.823233:0:13542:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789131369.823240:0:13542:0:(genops.c:885:class_export_put()) final put ffff9c0c43173800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789131369.823246:0:13542:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43173800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789131369.823255:0:13542:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789131369.823430:0:13542:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c0c43170800 00000020:02000400:3.0:1789131369.823493:0:13542:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789131370.073542:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131371.098440:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131372.123349:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131372.505697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131372.505711:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131372.505715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789131372.505719:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000004:0.0:1789131372.713609:0:13692:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789131372.727992:0:13692:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789131372.728106:0:13692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.728125:0:13692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.728132:0:13692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.728139:0:13692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.728166:0:13692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789131372.728173:0:13692:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789131372.728204:0:13692:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131372.728219:0:13692:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0b42cf2d00 x1876039910382848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789131382 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131372.728235:0:13692:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789131372.728274:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789131372.728295:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1789131372.728316:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910382848:0@lo:38:kworker.0 00000100:00080000:2.0:1789131372.728372:0:13692:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789131372.728379:0:13692:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789131372.728384:0:13692:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789131372.728386:0:13692:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789131372.728391:0:13692:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789131372.729474:0:13692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729492:0:13692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729500:0:13692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729508:0:13692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729532:0:13692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789131372.729540:0:13692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729548:0:13692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729555:0:13692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729562:0:13692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131372.729594:0:13692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1789131372.729599:0:13692:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789131372.729629:0:13692:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789131372.729635:0:13692:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789131372.729641:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789131372.729648:0:13692:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789131372.729653:0:13692:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c0c772b3490) has no exports 00000020:00080000:2.0:1789131372.729908:0:13692:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c0c772b3490) has no exports 00010000:00010000:3.0:1789131372.731378:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789131372.731394:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731408:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40030e00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131372.731413:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731425:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131372.731433:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131372.731440:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789131372.731443:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789131372.731446:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789131372.731468:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0c5fce6000 00010000:00010000:3.0:1789131372.731473:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731506:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40030e00/0x9f0de37187904480 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de37187904487 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731524:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789131372.731528:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731534:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c40031c00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131372.731538:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731546:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131372.731553:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131372.731559:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789131372.731562:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789131372.731564:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789131372.731569:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0c5fce6000 00010000:00010000:3.0:1789131372.731572:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731580:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40031c00/0x9f0de3718790448e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de37187904495 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731590:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131372.731594:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731605:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea200 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131372.731608:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731616:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131372.731622:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131372.731627:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789131372.731630:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789131372.731632:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789131372.731636:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0c5fce6000 00010000:00010000:3.0:1789131372.731640:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731647:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea200/0x9f0de371879046f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de371879046fd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131372.731660:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131372.731662:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131372.731664:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789131372.731682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789131372.731687:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789131372.732045:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131372.732090:0:11193:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789131372.733866:0:13692:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c7a001840 - data ffff9c0c6fe05e58/ffff9c0c74de5000 00000020:01000000:2.0:1789131372.734228:0:13692:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9c0c74e68f00 - data ffff9c0c6fe6f870/ffff9c0b411f0800 00100000:10000000:0.0:1789131372.747286:0:13692:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789131372.837768:0:13692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904376 00000020:00000080:0.0:1789131372.837783:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c7a5b3800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789131372.837812:0:13692:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0b41ae9800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789131372.837816:0:13692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0b41ae9800 2 00000020:01000004:0.0:1789131372.837819:0:13692:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c0b41ae9800 from lustre-OST0001 00000020:00000080:0.0:1789131372.837850:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131372.837862:0:13692:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789131372.837866:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c7a5b2000/lustre-OST0001_UUID 00000020:00000080:0.0:1789131372.837870:0:13692:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a5b2000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789131372.837878:0:13692:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1789131372.838051:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a5b3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1789131372.838271:0:13692:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 42008966-81eb-4eb4-8558-cee0fff8e6d5->MGS 00010000:00010000:0.0:1789131372.838292:0:13692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c40031a00/0x9f0de3718790427a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131372.838307:0:13692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c40031a00/0x9f0de3718790427a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131372.838314:0:13692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789131372.838318:0:13692:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789131372.838454:0:13692:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789131372.838481:0:13692:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0c5fce6000 00010000:00010000:0.0:1789131372.838486:0:13692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c40031a00/0x9f0de3718790427a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de37187904281 expref: -99 pid: 6702 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131372.838505:0:13692:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131372.838513:0:13692:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131372.838519:0:13692:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789131372.838535:0:13692:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789131372.838537:0:13692:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789131372.838550:0:13692:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c0c5fce6000 00010000:00010000:0.0:1789131372.838553:0:13692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c414a7400/0x9f0de37187904505 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9f0de3718790450c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789131372.838574:0:13692:0:(import.c:65:import_set_state_nolock()) ffff9c0c5fce6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789131372.838579:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789131372.838582:0:13692:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789131372.838584:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789131372.838588:0:13692:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789131372.838602:0:13692:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c0c7a424f00 x1876039910383360/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789131379 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789131372.838676:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789131372.838680:0:13692:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1789131372.838881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:42008966-81eb-4eb4-8558-cee0fff8e6d5:3305:1876039910383360:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:0.0:1789131372.839279:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789131372.839288:0:13692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904169 00000020:00000080:0.0:1789131372.839297:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c5fce5800/42008966-81eb-4eb4-8558-cee0fff8e6d5 00000020:01000000:0.0:1789131372.839317:0:13692:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:0.0:1789131372.839350:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131372.839358:0:13692:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789131372.839363:0:13692:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c0c492c0000) has no exports 10000000:01000000:2.0:1789131372.839430:0:5842:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789131372.839543:0:13692:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:0.0:1789131372.839546:0:13692:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789131372.839548:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789131372.839551:0:13692:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789131372.839553:0:13692:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789131372.839618:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131372.839626:0:13692:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid 42008966-81eb-4eb4-8558-cee0fff8e6d5) 00000020:01000000:0.0:1789131372.839633:0:13692:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789131372.839637:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131372.839641:0:13692:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789131372.839647:0:13692:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c0b4270c800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789131372.839661:0:13692:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9c0c43724ed8) has exports, disconnecting them 00000020:00080000:0.0:1789131372.839667:0:13692:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c0b4270c800), last request at 1789131171 00000020:00000080:0.0:1789131372.839672:0:13692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de371879043a0 00000020:00080000:0.0:1789131372.839686:0:13692:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c0b4270c800): rc 0 00000020:00000080:0.0:1789131372.839689:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0b4270c800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789131372.840617:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c5fce5800/42008966-81eb-4eb4-8558-cee0fff8e6d5 for MGC192.168.203.152@tcp 00000020:00000080:3.0:1789131372.840637:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0c5fce6000 for MGC192.168.203.152@tcp 00000020:00000080:3.0:1789131372.840654:0:37:0:(genops.c:885:class_export_put()) final put ffff9c0c472c8800/42008966-81eb-4eb4-8558-cee0fff8e6d5 00000020:00000080:3.0:1789131372.840656:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c472c8800/42008966-81eb-4eb4-8558-cee0fff8e6d5 for MGC192.168.203.152@tcp 00000020:01000000:3.0:1789131372.840662:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (42008966-81eb-4eb4-8558-cee0fff8e6d5) 00000020:00000080:3.0:1789131372.840983:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0b4270c800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789131372.854155:0:13692:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789131372.854168:0:13692:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789131372.854174:0:13692:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789131372.854184:0:13692:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789131372.854411:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789131372.854623:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789131372.854764:0:11193:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789131372.855064:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c0c4fab4200:5829] 1 exiting: rc = 0 00000020:00000080:3.0:1789131372.855203:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c0b4270b800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1789131372.855239:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c0c4fab4a00:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1789131372.855369:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.855717:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c0c4fab5800:5832] 2 exiting: rc = 0 00000100:00100000:3.0:1789131372.855792:0:8473:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c0c74221200:8473] 3 exiting: rc = 0 00000100:00100000:0.0:1789131372.856103:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c0c4fab5c00:5830] 0 exiting: rc = 1 00000100:00100000:0.0:1789131372.856170:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c0c4fab4800:5831] 1 exiting: rc = 0 00000100:00100000:3.0:1789131372.856430:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856439:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856447:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856454:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856462:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856471:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856479:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856487:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856494:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856501:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856508:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856516:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856524:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856530:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856538:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856545:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856553:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856561:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856567:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856573:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856579:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856585:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856592:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856598:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856626:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856632:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856638:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856645:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856651:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856657:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856663:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856669:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856674:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856680:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856686:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856693:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856700:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856706:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856713:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856718:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856725:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856731:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856737:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856743:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856749:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856755:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856761:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856766:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856772:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856778:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856783:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856789:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856795:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856800:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856807:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856812:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856820:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856826:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856832:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856846:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856852:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856858:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856864:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.856870:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789131372.858606:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789131372.858624:0:13692:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789131372.858631:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c7a79f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789131372.858637:0:13692:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c7a79f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789131372.858644:0:13692:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789131372.858704:0:13692:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0b41ae9800 1 00000020:00000080:3.0:1789131372.858711:0:13692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x9f0de37187904345 00000020:00000080:3.0:1789131372.858719:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c81e76000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789131372.858775:0:13692:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789131372.858781:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789131372.858786:0:13692:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789131372.858790:0:13692:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c0c772b0000) has no exports 00000020:00000080:2.0:1789131372.859248:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c81e76000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789131372.872562:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131372.872596:0:13692:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789131372.872603:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c80d4e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789131372.872609:0:13692:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c80d4e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789131372.872621:0:13692:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789131372.872875:0:13692:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c0c80d67800 00000020:01000000:0.0:1789131372.874515:0:13692:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789131372.874528:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789131372.874537:0:13692:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789131372.874543:0:13692:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c0c492c1a48) has no exports 00000020:00000080:0.0:1789131372.874578:0:13692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789131372.874588:0:13692:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789131372.874594:0:13692:0:(genops.c:885:class_export_put()) final put ffff9c0c43177000/OSS_uuid 00000020:00000080:0.0:1789131372.874599:0:13692:0:(genops.c:844:class_export_destroy()) destroying export ffff9c0c43177000/OSS_uuid for OSS 00000020:01000000:0.0:1789131372.874605:0:13692:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789131372.874721:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c0c47e42e00:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1789131372.874849:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c0c47e43000:6706] 2 exiting: rc = 0 00000100:00100000:0.0:1789131372.874921:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c0c51ad5000:6704] 0 exiting: rc = 1 00000100:00080000:3.0:1789131372.875058:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789131372.875280:0:12438:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9c0c81c40e00:12438] 4 exiting: rc = 0 00000100:00100000:3.0:1789131372.876458:0:8327:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c0b41ae1e00:8327] 3 exiting: rc = 0 00000100:00100000:0.0:1789131372.877164:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877185:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877192:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877200:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877206:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877212:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877218:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877224:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877229:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877235:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877240:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877245:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877250:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877256:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877262:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877268:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877273:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877279:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877286:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877306:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877311:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877317:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877455:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877463:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877469:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877475:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877481:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877488:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877494:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877500:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877507:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877513:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877519:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877544:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877550:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877556:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877562:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877567:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877573:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877578:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877584:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877592:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877597:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877602:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877607:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877613:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877618:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877623:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877632:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877641:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877647:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877654:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877658:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877663:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877670:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877675:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877684:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877692:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877698:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877704:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877710:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877716:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877721:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.877728:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.879066:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c0c47e43800:6709] 1 exiting: rc = 0 00000100:00100000:0.0:1789131372.879389:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c0c47e42000:6708] 0 exiting: rc = 1 00000100:00100000:0.0:1789131372.880507:0:10566:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c0c7a008a00:10566] 2 exiting: rc = 0 00000100:00100000:3.0:1789131372.880648:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880661:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880667:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880674:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880680:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880685:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880690:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880695:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880700:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880706:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880711:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880717:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880723:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880747:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880752:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880758:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880763:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880770:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880775:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880782:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880788:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880794:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880801:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880808:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880814:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880821:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880828:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880833:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880840:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880846:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880852:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880858:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880864:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880870:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880876:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880893:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880908:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880915:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880921:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880927:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880933:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880939:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880945:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880951:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880957:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880961:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880967:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880972:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880987:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880992:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.880998:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881005:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881011:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881017:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881023:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881029:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881035:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881042:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881048:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881054:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881060:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881065:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881071:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.881087:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.882232:0:6711:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c0c4622fa00:6711] 1 exiting: rc = 0 00000100:00100000:0.0:1789131372.882984:0:6712:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c0c4622e600:6712] 2 exiting: rc = 0 00000100:00100000:0.0:1789131372.883349:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c0c4622ea00:6710] 0 exiting: rc = 1 00000100:00100000:3.0:1789131372.883593:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883604:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883610:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883617:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883624:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883630:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883637:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883644:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883651:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883658:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883665:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883672:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883680:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883687:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883693:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883700:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883707:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883728:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883743:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883750:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883757:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883764:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883770:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883777:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883783:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883790:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883797:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883803:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883810:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883816:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883822:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883828:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883835:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883842:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883849:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883855:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883861:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883867:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.883874:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884028:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884045:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884211:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884219:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884226:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884233:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884240:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884246:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884252:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884259:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884275:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884400:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884619:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884629:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884645:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884656:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884662:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884668:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884674:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884680:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884686:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884692:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884698:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884703:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.884710:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.897183:0:6714:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c0c47e43200:6714] 1 exiting: rc = 0 00000100:00100000:0.0:1789131372.900244:0:6713:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c0c4622e800:6713] 0 exiting: rc = 1 00000100:00100000:3.0:1789131372.900738:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900749:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900756:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900762:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900767:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900774:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900780:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900785:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900791:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900796:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900802:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900808:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900814:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900820:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900828:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900835:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900841:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900847:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900854:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900860:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900865:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900871:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900877:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900926:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900932:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900938:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900945:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900951:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900957:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900962:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900990:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.900998:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901003:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901009:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901014:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901020:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901026:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901031:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901038:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901043:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901049:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901055:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901060:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901065:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901071:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901076:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901100:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901105:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901111:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901117:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901122:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901129:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901134:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901140:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901146:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901151:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901158:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901163:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901179:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901184:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901188:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901194:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901198:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.901204:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789131372.902127:0:6715:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c0c47e43400:6715] 0 exiting: rc = 1 00000100:00100000:2.0:1789131372.902225:0:6716:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c0c52d14800:6716] 1 exiting: rc = 0 00000100:00100000:3.0:1789131372.903477:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903504:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903537:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903545:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903551:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903558:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903565:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903576:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903582:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903589:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903595:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903601:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903609:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903615:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903643:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903651:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903658:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903665:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903672:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903679:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903685:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903693:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903700:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903706:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903713:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903719:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903746:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903754:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903761:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903784:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903790:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903796:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903803:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903810:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903817:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903824:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903831:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903838:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903860:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903868:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.903876:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904062:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904073:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904088:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904096:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904103:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904111:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904118:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904125:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904132:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904153:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904162:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904168:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904176:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904182:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904190:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904196:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904203:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904211:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904219:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904226:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904234:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904253:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789131372.904262:0:13692:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789131372.918520:0:13692:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1789131387.783128:0:14311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789131395.360612:0:14773:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789131395.360618:0:14773:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789131395.360717:0:14773:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0c43172000 00000020:01000004:3.0:1789131395.360731:0:14773:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789131395.360739:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789131395.360754:0:14773:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c0c76120000) 00000020:00000080:3.0:1789131395.360767:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789131395.378202:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789131395.380494:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789131395.380906:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:1.0:1789131395.381311:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:1.0:1789131395.381436:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:1.0:1789131395.381532:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:1.0:1789131395.381783:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789131395.381917:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:1.0:1789131395.382022:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:1.0:1789131395.382465:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 512: rc = 0 00100000:10000000:1.0:1789131395.384732:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:1.0:1789131395.384906:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:1.0:1789131395.387003:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.387236:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 461: rc = 0 00100000:10000000:1.0:1789131395.387522:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 461: rc = 0 00100000:10000000:1.0:1789131395.387782:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.388036:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.388283:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 461: rc = 0 00100000:10000000:1.0:1789131395.389292:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.389717:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.390168:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 461: rc = 0 00100000:10000000:1.0:1789131395.390672:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 461: rc = 0 00100000:10000000:1.0:1789131395.391029:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 461: rc = 0 00100000:10000000:1.0:1789131395.391392:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 461: rc = 0 00100000:10000000:1.0:1789131395.392280:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 661: rc = 0 00100000:10000000:1.0:1789131395.392670:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 661: rc = 0 00100000:10000000:1.0:1789131395.393102:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 661: rc = 0 00100000:10000000:1.0:1789131395.393645:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 661: rc = 0 00100000:10000000:1.0:1789131395.394031:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 661: rc = 0 00100000:10000000:1.0:1789131395.394438:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 661: rc = 0 00100000:10000000:1.0:1789131395.394745:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 661: rc = 0 00100000:10000000:1.0:1789131395.395094:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 661: rc = 0 00100000:10000000:1.0:1789131395.395427:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 661: rc = 0 00100000:10000000:1.0:1789131395.395762:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 661: rc = 0 00100000:10000000:1.0:1789131395.396103:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 661: rc = 0 00100000:10000000:2.0:1789131395.396899:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 661: rc = 0 00100000:10000000:2.0:1789131395.397439:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 661: rc = 0 00100000:10000000:2.0:1789131395.399962:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 661: rc = 0 00100000:10000000:2.0:1789131395.400388:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 661: rc = 0 00100000:10000000:2.0:1789131395.400624:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 661: rc = 0 00100000:10000000:2.0:1789131395.401637:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 661: rc = 0 00100000:10000000:2.0:1789131395.401907:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 661: rc = 0 00100000:10000000:2.0:1789131395.403159:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 661: rc = 0 00100000:10000000:2.0:1789131395.403663:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 661: rc = 0 00100000:10000000:2.0:1789131395.404092:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 661: rc = 0 00100000:10000000:2.0:1789131395.404379:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 661: rc = 0 00100000:10000000:2.0:1789131395.404646:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 661: rc = 0 00100000:10000000:2.0:1789131395.404892:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 661: rc = 0 00100000:10000000:2.0:1789131395.405158:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 661: rc = 0 00100000:10000000:2.0:1789131395.405390:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 661: rc = 0 00100000:10000000:2.0:1789131395.405605:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 661: rc = 0 00100000:10000000:2.0:1789131395.405847:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 661: rc = 0 00100000:10000000:2.0:1789131395.406437:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 661: rc = 0 00100000:10000000:2.0:1789131395.406887:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 661: rc = 0 00100000:10000000:2.0:1789131395.407213:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 661: rc = 0 00100000:10000000:2.0:1789131395.407622:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 661: rc = 0 00100000:10000000:2.0:1789131395.407981:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 153: rc = 0 00100000:10000000:2.0:1789131395.408675:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789131395.408832:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1789131395.409182:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789131395.409254:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1789131395.409667:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789131395.409727:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1789131395.410064:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789131395.410133:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 459: rc = 0 00100000:10000000:2.0:1789131395.410627:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789131395.410696:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 459: rc = 0 00100000:10000000:2.0:1789131395.410875:0:14773:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789131395.411016:0:14773:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 459: rc = 0 00000020:00000080:2.0:1789131395.411275:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789131395.411288:0:14773:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131395.411297:0:14773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de371879054a9 00000020:01000004:2.0:1789131395.411304:0:14773:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789131395.411310:0:14773:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789131395.411315:0:14773:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0c43172000 from MGS 00000020:01000004:2.0:1789131395.411319:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789131395.411407:0:14773:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c0b41cf0000) 00000020:00000080:2.0:1789131395.411418:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789131395.411536:0:14773:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43172000 from MGS, refs=2 00080000:01000000:2.0:1789131395.411541:0:14773:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789131395.411546:0:14773:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de371879054b7 00000100:00100000:2.0:1789131395.411653:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789131395.412611:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789131395.412618:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1789131395.413094:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1789131395.413102:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789131395.414862:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131395.415478:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789131395.415484:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789131395.417936:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789131395.417949:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789131395.419872:0:14773:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789131395.419883:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789131395.423772:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131395.423779:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131395.423781:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131395.424586:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131395.424590:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131395.424592:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131395.425602:0:14773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789131395.429968:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789131395.442464:0:14773:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789131395.442483:0:14773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789131395.442485:0:14773:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789131395.453481:0:14782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789131395.453662:0:14773:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789131395.453774:0:14773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789131395.454273:0:14773:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789131395.454637:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131395.454804:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789131395.454809:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789131395.456215:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789131395.456225:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789131395.457052:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789131395.457060:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789131395.459430:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789131395.459456:0:14773:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:1.0:1789131395.459458:0:14773:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789131395.459487:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:1.0:1789131395.459499:0:14773:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff9c0c772b4ed8) 00000020:00000080:1.0:1789131395.459513:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789131395.459582:0:14773:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0b437b7800@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1789131395.459721:0:14773:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:1.0:1789131395.459726:0:14773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789131395.465507:0:14787:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789131395.465626:0:14788:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789131395.465770:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 80da979a-4558-4a65-9d4f-bd9ca48c3a0e) 00000020:00000080:0.0:1789131395.465854:0:14773:0:(genops.c:1385:class_connect()) connect: client 80da979a-4558-4a65-9d4f-bd9ca48c3a0e, cookie 0x9f0de371879054c5 00000100:00080000:0.0:1789131395.465867:0:14773:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789131395.465873:0:14773:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff9c0b437b7800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131395.465906:0:14773:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b42cf03c0 x1876039910383488/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131395.465939:0:14773:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 80da979a-4558-4a65-9d4f-bd9ca48c3a0e->MGS 00000020:01000004:0.0:1789131395.465958:0:14773:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789131395.465963:0:14773:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789131395.465976:0:14773:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c0c43721a48) 00000020:00000080:0.0:1789131395.465987:0:14773:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789131395.467463:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3305:1876039910383488:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789131395.467556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131395.467636:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383488 00000100:00100000:2.0:1789131395.467644:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383488 00000100:00100000:2.0:1789131395.467690:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131395.467697:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1876039910383488:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789131395.467722:0:14784:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 80da979a-4558-4a65-9d4f-bd9ca48c3a0e@0@lo t0 exp 0000000000000000 cur 407 last 0 00000020:00000080:2.0:1789131395.467762:0:14784:0:(genops.c:1385:class_connect()) connect: client 80da979a-4558-4a65-9d4f-bd9ca48c3a0e, cookie 0x9f0de371879054d3 00000100:00080000:2.0:1789131395.467916:0:14784:0:(import.c:65:import_set_state_nolock()) ffff9c0c81e72000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131395.468198:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:3305:x1876039910383488:12345-0@lo:250:mount.lustre.0 Request processed in 285us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.468215:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789131395.468256:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789131395.468264:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1789131395.468273:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789131395.468278:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789131395.468281:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b437b7800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789131395.468284:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789131395.468299:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789131395.468305:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3305:1876039910383488:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789131395.478223:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131395.478600:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789131395.478607:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789131395.482284:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789131395.482295:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789131395.484650:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789131395.484661:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789131395.487417:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131395.487610:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789131395.487616:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789131395.488498:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789131395.488515:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789131395.535289:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131395.535615:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789131395.535622:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789131395.536966:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789131395.536978:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789131395.537832:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131395.538006:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789131395.538012:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789131395.538615:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789131395.538623:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789131395.539176:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131395.539814:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789131395.539826:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789131395.540424:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789131395.540431:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789131395.541096:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131395.541257:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789131395.541262:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789131395.543830:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789131395.543843:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789131395.559553:0:14773:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789131395.559755:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789131395.559762:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789131395.561808:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789131395.561821:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789131395.565649:0:14773:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789131395.565665:0:14773:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789131395.569006:0:14773:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789131395.569045:0:14773:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789131395.569052:0:14773:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789131395.569186:0:14773:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789131395.569221:0:14773:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789131395.569226:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789131395.569227:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131395.569229:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131395.569230:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131395.569231:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131395.569233:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131395.569234:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131395.569236:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131395.569237:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131395.569239:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131395.569241:0:14773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789131395.569243:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789131395.569245:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131395.569246:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131395.569247:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131395.569248:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131395.569249:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131395.569250:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131395.569251:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131395.569252:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131395.569253:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789131395.569280:0:14773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789131395.569300:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383616:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789131395.569391:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.569441:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.570288:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383616 00000100:00100000:3.0:1789131395.570305:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383616 00000100:00100000:3.0:1789131395.570383:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131395.570394:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:14773:x1876039910383616:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789131395.570449:0:14786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789131395.570453:0:14786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789131395.570456:0:14786:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789131395.570971:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789131395.571517:0:14786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789131395.572744:0:14808:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789131395.572750:0:14808:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789131395.572752:0:14808:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789131395.572785:0:14808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789131395.573150:0:14786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789131395.573160:0:14786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789131395.589686:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:14773:x1876039910383616:12345-0@lo:253:mount.lustre.0 Request processed in 19286us (20287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.589699:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131395.589899:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789131395.589915:0:14773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789131395.589929:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131395.589931:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789131395.589932:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131395.589933:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131395.589935:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131395.589936:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131395.589938:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789131395.589940:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789131395.589942:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131395.589943:0:14773:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789131395.589963:0:14773:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0c43172000 from lustre-MDT0000 10000000:01000000:1.0:1789131395.589991:0:14773:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789131395.589994:0:14773:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789131395.589998:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c0c772b4ed8 10000000:01000000:1.0:1789131395.590002:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131395.590010:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c0c772b4ed8 from 1 10000000:01000000:1.0:1789131395.590014:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789131395.590311:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.590357:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.590368:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.590388:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131395.590426:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.590461:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131395.591118:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383744 00000100:00100000:2.0:1789131395.591126:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383744 00000100:00100000:2.0:1789131395.591177:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789131395.591187:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:14773:x1876039910383744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131395.591200:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131395.591229:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b0600/0x9f0de371879054e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879054da expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.591254:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b0600/0x9f0de371879054e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879054da expref: 6 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.591264:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b0600/0x9f0de371879054e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879054da expref: 6 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.591273:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0600, rc 0) 00000100:00100000:2.0:1789131395.591346:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+6:14773:x1876039910383744:12345-0@lo:101:mount.lustre.0 Request processed in 161us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.591352:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131395.591503:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131395.591517:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.591807:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131395.591873:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131395.591906:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131395.591939:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.592563:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910383872 00000100:00100000:0.0:1789131395.592574:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910383872 00000100:00100000:0.0:1789131395.592618:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131395.592625:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+6:14773:x1876039910383872:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.592879:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+6:14773:x1876039910383872:12345-0@lo:501:mount.lustre.0 Request processed in 253us (971us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789131395.592886:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131395.593411:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910383872:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789131395.593448:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789131395.593467:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.593477:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131395.593496:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0c43172000 10000000:01000000:3.0:1789131395.593501:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789131395.593506:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c0c43172000 10000000:01000000:3.0:1789131395.593508:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789131395.593511:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c0c43172000 from 1 10000000:01000000:3.0:1789131395.593514:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789131395.593554:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.593580:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.593590:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131395.593609:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384000:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789131395.593642:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131395.593674:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789131395.593904:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384000 00000100:00100000:2.0:1789131395.593910:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384000 00000100:00100000:2.0:1789131395.593951:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131395.593958:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+6:14773:x1876039910384000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131395.593968:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131395.593981:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b1000/0x9f0de371879054ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879054e8 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.594001:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b1000/0x9f0de371879054ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879054e8 expref: 7 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.594010:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b1000/0x9f0de371879054ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879054e8 expref: 7 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.594017:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1000, rc 0) 00000100:00100000:2.0:1789131395.594057:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+7:14773:x1876039910384000:12345-0@lo:101:mount.lustre.0 Request processed in 99us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.594072:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131395.594138:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131395.594158:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054ef expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.594167:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879054ef expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131395.594179:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789131395.594198:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054ef expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.594205:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c7473fe00/0x9f0de371879054e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054ef expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131395.594212:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789131395.594216:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131395.594220:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c0c43172000 10000000:01000000:1.0:1789131395.594223:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789131395.594226:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789131395.594228:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789131395.594244:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.594251:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.594259:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.594272:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131395.594306:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.594342:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.595261:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384128 00000100:00100000:0.0:1789131395.595269:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384128 00000100:00100000:0.0:1789131395.595297:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131395.595305:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+7:14773:x1876039910384128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131395.595315:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131395.595348:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15200/0x9f0de371879054fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879054f6 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.595366:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15200/0x9f0de371879054fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879054f6 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.595375:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15200/0x9f0de371879054fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879054f6 expref: 8 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.595382:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15200, rc 0) 00000100:00100000:0.0:1789131395.595424:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+8:14773:x1876039910384128:12345-0@lo:101:mount.lustre.0 Request processed in 120us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.595431:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789131395.595496:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131395.595510:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054fd expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.595544:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879054fd expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.595595:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.595618:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.595635:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384256 00000100:00100000:0.0:1789131395.595638:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384256 00000100:00100000:0.0:1789131395.595651:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131395.595655:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+8:14773:x1876039910384256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.596218:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14773:x1876039910384256:12345-0@lo:501:mount.lustre.0 Request processed in 561us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.596226:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131395.596258:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.596268:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.596288:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131395.596347:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.596366:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.596995:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384384 00000100:00100000:3.0:1789131395.597001:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384384 00000100:00100000:3.0:1789131395.597035:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131395.597043:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14773:x1876039910384384:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131395.597433:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14773:x1876039910384384:12345-0@lo:503:mount.lustre.0 Request processed in 390us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.597439:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789131395.597776:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910384384:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131395.599671:0:14809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14809:1876039910384512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131395.599745:0:14809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131395.599787:0:14809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51f9d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131395.599807:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384512 00000100:00100000:2.0:1789131395.599813:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384512 00000100:00100000:2.0:1789131395.599855:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789131395.599864:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14809:x1876039910384512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131395.600417:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14809:x1876039910384512:12345-0@lo:502:llog_process_th.0 Request processed in 551us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.600437:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131395.600934:0:14809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14809:1876039910384512:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131395.600977:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131395.601005:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.601008:0:14809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789131395.601013:0:14809:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789131395.601017:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131395.601046:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c0c76123490) 00000020:00000080:3.0:1789131395.601074:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789131395.601080:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789131395.601148:0:14809:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789131395.601155:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790550b 00000020:00000080:3.0:1789131395.602470:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789131395.602480:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131395.602496:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.602499:0:14809:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789131395.602502:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131395.602507:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.602509:0:14809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789131395.602512:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131395.602535:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c0c76124ed8) 00000020:00000080:3.0:1789131395.602551:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789131395.602556:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789131395.602558:0:14809:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789131395.602561:0:14809:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789131395.602566:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789131395.602633:0:14809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43172000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789131395.602645:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c0c76121a48) 00000020:00000080:3.0:1789131395.602653:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789131395.602693:0:14809:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789131395.602698:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187905520 00000020:00000080:3.0:1789131395.603193:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789131395.603201:0:14809:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789131395.603206:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9f0de37187905527 00080000:01000000:3.0:1789131395.603212:0:14809:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789131395.603216:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790552e 00010000:00010000:2.0:1789131395.676166:0:14809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789131395.679434:0:14809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789131395.679697:0:14809:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789131395.680832:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c0b41cf3490) 00000020:00000080:2.0:1789131395.680915:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789131395.681016:0:14809:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789131395.681026:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de3718790553c 00000020:00000080:2.0:1789131395.681994:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789131395.689397:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9f0de37187905543 00000020:00000080:3.0:1789131395.690220:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789131395.690232:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131395.690238:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.690241:0:14809:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789131395.690243:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131395.690249:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.690257:0:14809:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789131395.690262:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789131395.690300:0:14809:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789131395.690312:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131395.690315:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.690316:0:14809:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789131395.690318:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789131395.690355:0:14809:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789131395.690357:0:14809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789131395.690359:0:14809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789131395.690360:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789131395.690363:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.690365:0:14809:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789131395.690367:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789131395.690370:0:14809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789131395.690374:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.690375:0:14809:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789131395.690379:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789131395.690389:0:14809:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:3.0:1789131395.690416:0:14809:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789131395.690419:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789131395.690432:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c0c492c1a48) 00000020:00000080:3.0:1789131395.690445:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789131395.690450:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789131395.690797:0:14809:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789131395.690802:0:14809:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789131395.690809:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de37187905551 00010000:00080000:1.0:1789131395.690845:0:14809:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0c80d4a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1789131395.691053:0:14809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789131395.691477:0:14809:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789131395.691522:0:14809:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789131395.692611:0:14809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131395.692759:0:14809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789131395.692838:0:14809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789131395.693365:0:14813:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789131395.693371:0:14813:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789131395.694073:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789131395.694091:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789131395.694194:0:14809:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789131395.694217:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187905558 00000100:00080000:2.0:1789131395.694227:0:14809:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789131395.694233:0:14809:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c0c80d4a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1789131395.694264:0:14809:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a4252c0 x1876039910384640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789131395.694307:0:14809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789131395.694395:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131395.694399:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.694401:0:14809:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789131395.694404:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789131395.694406:0:14809:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789131395.694408:0:14809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131395.694409:0:14809:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789131395.694411:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789131395.694413:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.694414:0:14809:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789131395.694417:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789131395.694420:0:14809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789131395.694423:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.694424:0:14809:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789131395.694427:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789131395.694430:0:14809:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1789131395.694451:0:14809:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789131395.694455:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789131395.694467:0:14809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c0b41cf1a48) 00000020:00000080:2.0:1789131395.694478:0:14809:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789131395.694483:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789131395.694536:0:14809:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789131395.694541:0:14809:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789131395.694548:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9f0de37187905566 00010000:00080000:2.0:1789131395.694577:0:14809:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0c43e94800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00000100:00100000:0.0:1789131395.694757:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910384640:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789131395.694817:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039910384640 offset 0 length 520: 4 00010000:00010000:2.0:1789131395.695434:0:14809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789131395.695613:0:14809:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789131395.695635:0:14809:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789131395.696408:0:14809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131395.696470:0:14809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789131395.696551:0:14809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789131395.699857:0:14815:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789131395.699865:0:14815:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789131395.704836:0:14809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789131395.704852:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789131395.704893:0:14809:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789131395.704915:0:14809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de3718790556d 00000100:00080000:1.0:1789131395.704937:0:14809:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131395.704943:0:14809:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0c43e94800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131395.704980:0:14809:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d84000 x1876039910384768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131395.705012:0:14809:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789131395.705075:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131395.705079:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131395.705081:0:14809:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789131395.705084:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131395.705087:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131395.705088:0:14809:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789131395.705091:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789131395.705104:0:14809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789131395.705107:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131395.705109:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131395.705111:0:14809:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789131395.705113:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131395.705116:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131395.705118:0:14809:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789131395.705121:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789131395.705149:0:14809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14809:1876039910384896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131395.705224:0:14809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.705257:0:14809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.705415:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910384768:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789131395.705443:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039910384768 offset 0 length 520: 4 00000100:00100000:3.0:1789131395.705981:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910384896 00000100:00100000:3.0:1789131395.705988:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910384896 00000100:00100000:3.0:1789131395.706039:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131395.706050:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14809:x1876039910384896:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131395.706381:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14809:x1876039910384896:12345-0@lo:502:llog_process_th.0 Request processed in 332us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.706388:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789131395.710713:0:14809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14809:1876039910384896:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789131395.716238:0:14809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131395.716257:0:14809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131395.716260:0:14809:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789131395.716269:0:14809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789131395.716610:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789131395.716648:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789131395.716678:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054fd expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.716689:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4000/0x9f0de371879054f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054fd expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131395.716698:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43172000 from 1 10000000:01000000:0.0:1789131395.716701:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131395.716739:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.716746:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.716756:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.716778:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789131395.716842:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.716887:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42cb3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.717007:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385024 00000100:00100000:3.0:1789131395.717014:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385024 00000100:00100000:3.0:1789131395.717051:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131395.717059:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+9:14773:x1876039910385024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131395.717071:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131395.717085:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905574 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.717105:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905574 expref: 10 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.717114:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905574 expref: 10 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.717122:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f200, rc 0) 00000100:00100000:3.0:1789131395.717167:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+10:14773:x1876039910385024:12345-0@lo:101:mount.lustre.0 Request processed in 108us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.717174:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131395.717246:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf03c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385024:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131395.717261:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.717270:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.717859:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385152:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789131395.717899:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.717941:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789131395.718148:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385152 00000100:00100000:2.0:1789131395.718154:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385152 00000100:00100000:2.0:1789131395.718195:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131395.718203:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+10:14773:x1876039910385152:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789131395.718222:0:14785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789131395.718228:0:14785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789131395.718300:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+10:14773:x1876039910385152:12345-0@lo:256:mount.lustre.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131395.718306:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131395.718627:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385152:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789131395.719840:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789131395.719926:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.719939:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131395.719965:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172000 from 1 10000000:01000000:1.0:1789131395.719968:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131395.720004:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.720012:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.720021:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.720041:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385280:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131395.720096:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.720143:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.721517:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385280 00000100:00100000:3.0:1789131395.721528:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385280 00000100:00100000:3.0:1789131395.721599:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789131395.721608:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+10:14773:x1876039910385280:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131395.721624:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131395.721642:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905582 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.721693:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905582 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.721703:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905582 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.721712:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f800, rc 0) 00000100:00100000:3.0:1789131395.721771:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385280:12345-0@lo:101:mount.lustre.0 Request processed in 164us (1674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.721778:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131395.723830:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385280:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131395.723859:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.723870:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.723959:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131395.724016:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.724050:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.724157:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385408 00000100:00100000:0.0:1789131395.724163:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385408 00000100:00100000:0.0:1789131395.724204:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789131395.724214:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.724641:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385408:12345-0@lo:501:mount.lustre.0 Request processed in 428us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.724650:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131395.725525:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385408:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131395.725570:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385536:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131395.725622:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.725657:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.725754:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385536 00000100:00100000:3.0:1789131395.725760:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385536 00000100:00100000:3.0:1789131395.725806:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789131395.725814:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385536:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131395.725987:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385536:12345-0@lo:503:mount.lustre.0 Request processed in 174us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.725994:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789131395.726277:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131395.728179:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14817:1876039910385664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789131395.728247:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131395.728296:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42c460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.731523:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385664 00000100:00100000:0.0:1789131395.731552:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385664 00000100:00100000:0.0:1789131395.731613:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789131395.731624:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14817:x1876039910385664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131395.732283:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14817:x1876039910385664:12345-0@lo:502:llog_process_th.0 Request processed in 659us (4034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.732293:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789131395.732718:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14817:1876039910385664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131395.732763:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131395.732772:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732774:0:14817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789131395.732781:0:14817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43172000 00000020:00000080:2.0:1789131395.732784:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131395.732791:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131395.732793:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732794:0:14817:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789131395.732797:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131395.732799:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732800:0:14817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789131395.732803:0:14817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43172000 00000020:00000080:2.0:1789131395.732805:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131395.732860:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131395.732863:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732865:0:14817:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789131395.732867:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131395.732869:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732877:0:14817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131395.732882:0:14817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43172000 00000020:00000080:2.0:1789131395.732885:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789131395.732905:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131395.732908:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.732909:0:14817:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789131395.732912:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131395.733064:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.733066:0:14817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789131395.733072:0:14817:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43172000 00000020:00000080:2.0:1789131395.733075:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789131395.733125:0:14817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14817:1876039910385792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131395.733175:0:14817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131395.733212:0:14817:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43147d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.733271:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385792 00000100:00100000:0.0:1789131395.733276:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385792 00000100:00100000:0.0:1789131395.733341:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789131395.733350:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14817:x1876039910385792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131395.733539:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14817:x1876039910385792:12345-0@lo:502:llog_process_th.0 Request processed in 190us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.733547:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789131395.733690:0:14817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14817:1876039910385792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789131395.733714:0:14817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131395.733719:0:14817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131395.733720:0:14817:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789131395.733724:0:14817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789131395.740711:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789131395.740746:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131395.740770:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.740783:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131395.740832:0:14773:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789131395.740835:0:14773:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0c43172000 10000000:01000000:0.0:1789131395.740838:0:14773:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0c43172000 10000000:01000000:0.0:1789131395.740841:0:14773:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131395.740848:0:14773:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43172000 from 1 10000000:01000000:0.0:1789131395.740850:0:14773:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131395.740885:0:14773:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.740901:0:14773:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.740915:0:14773:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.740950:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385920:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789131395.741016:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.741052:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.741078:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910385920 00000100:00100000:0.0:1789131395.741084:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910385920 00000100:00100000:0.0:1789131395.741126:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131395.741134:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910385920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131395.741147:0:14786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131395.741159:0:14786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14600/0x9f0de37187905597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905590 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.741183:0:14786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14600/0x9f0de37187905597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905590 expref: 12 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.741194:0:14786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14600/0x9f0de37187905597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905590 expref: 12 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.741202:0:14786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14600, rc 0) 00000100:00100000:0.0:1789131395.741237:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910385920:12345-0@lo:101:mount.lustre.0 Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.741244:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131395.741298:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910385920:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131395.741313:0:14773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905597 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.741343:0:14773:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905597 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.741392:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.741415:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.741428:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.748429:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386048 00000100:00100000:3.0:1789131395.748442:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386048 00000100:00100000:3.0:1789131395.748556:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789131395.748566:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910386048:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131395.748875:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910386048:12345-0@lo:501:mount.lustre.0 Request processed in 310us (7457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.748892:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789131395.753621:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386048:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131395.753683:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131395.753758:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131395.753795:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.753883:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386176 00000100:00100000:0.0:1789131395.753890:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386176 00000100:00100000:0.0:1789131395.753988:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789131395.753997:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910386176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131395.754191:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910386176:12345-0@lo:503:mount.lustre.0 Request processed in 194us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.754200:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789131395.757692:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf1680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386176:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131395.761667:0:14822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14822:1876039910386304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131395.761746:0:14822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.761788:0:14822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461a1540 going to sleep for 11 seconds 00000100:00100000:0.0:1789131395.764857:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386304 00000100:00100000:0.0:1789131395.764870:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386304 00000100:00100000:0.0:1789131395.764941:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789131395.764952:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14822:x1876039910386304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789131395.765243:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14822:x1876039910386304:12345-0@lo:502:llog_process_th.0 Request processed in 293us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.765257:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789131395.766241:0:14822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14822:1876039910386304:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789131395.766313:0:14822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789131395.766354:0:14822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c0c772b1a48) 00000020:00000080:1.0:1789131395.766375:0:14822:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1789131395.766470:0:14822:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43172000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789131395.766474:0:14822:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43172000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789131395.766477:0:14822:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43172000 4 00010000:00080000:1.0:1789131395.766614:0:14822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0c52a90000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1789131395.771065:0:14822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1789131395.773137:0:14822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789131395.773178:0:14822:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789131395.773192:0:14822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9f0de371879055a5 00000100:00080000:1.0:1789131395.773203:0:14822:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789131395.773209:0:14822:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c0c52a90000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131395.773244:0:14822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d852c0 x1876039910386432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131395.773273:0:14822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789131395.773688:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910386432:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789131395.773757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.773930:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386432 00000100:00100000:1.0:1789131395.773937:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386432 00000100:00100000:1.0:1789131395.773970:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131395.773977:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910386432:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131395.774043:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910386432:12345-0@lo:38:llog_process_th.0 Request processed in 65us (285us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789131395.774051:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131395.774132:0:14822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14822:1876039910386560:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789131395.774178:0:14822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.774195:0:14822:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131395.774215:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386560 00000100:00100000:1.0:1789131395.774219:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386560 00000100:00100000:1.0:1789131395.774250:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789131395.774257:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14822:x1876039910386560:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789131395.774600:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789131395.774609:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c52a90000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789131395.774613:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789131395.774617:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910386432:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131395.774872:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14822:x1876039910386560:12345-0@lo:502:llog_process_th.0 Request processed in 614us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131395.774880:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789131395.778047:0:14822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14822:1876039910386560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789131395.778093:0:14822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789131395.778199:0:14773:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789131395.778224:0:14773:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789131395.778250:0:14773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905597 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131395.778260:0:14773:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e15000/0x9f0de37187905590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905597 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789131395.778300:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789131395.778302:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789131395.778304:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131395.778305:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131395.778306:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131395.778308:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131395.778309:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131395.778310:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789131395.778312:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131395.778313:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131395.778317:0:14773:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789131395.778339:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131395.778341:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789131395.778342:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131395.778343:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131395.778344:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131395.778345:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131395.778346:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131395.778348:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789131395.778349:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131395.778350:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131395.778371:0:14773:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789131395.778386:0:14773:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386688:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131395.778454:0:14773:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131395.778497:0:14773:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b431476c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131395.778516:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386688 00000100:00100000:2.0:1789131395.778527:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386688 00000100:00100000:2.0:1789131395.778574:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131395.778583:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14773:x1876039910386688:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789131395.778608:0:14785:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789131395.778620:0:14785:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789131395.828098:0:14785:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789131395.828161:0:14785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789131395.830651:0:14807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789131395.830662:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789131395.830688:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.830707:0:14807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905574 expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.830715:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.830824:0:14807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131395.830839:0:14807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 12 pid: 14784 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131395.830871:0:14807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d861c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910386816:0@lo:104: 00000100:00100000:1.0:1789131395.830944:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131395.831040:0:14807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b438f0480 going to sleep for 11 seconds 00000100:00100000:3.0:1789131395.833608:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386816 00000100:00100000:3.0:1789131395.833621:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386816 00000100:00100000:3.0:1789131395.833666:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131395.833675:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910386816:12345-0@lo:104: 00010000:00010000:3.0:1789131395.833691:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835414:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789131395.835428:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910386816:12345-0@lo:104: Request processed in 1750us (4480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.835439:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789131395.835479:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131395.835500:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835511:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14c00 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131395.835515:0:14780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835524:0:14780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131395.835532:0:14780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131395.835538:0:14780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789131395.835583:0:14780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835609:0:14780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131395.835644:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835651:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14c00/0x9f0de37187905574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790557b expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.835669:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131395.835671:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131395.835673:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131395.835705:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131395.835719:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910386944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131395.836162:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131395.836300:0:14807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d861c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910386816:0@lo:104: 00010000:00010000:3.0:1789131395.836365:0:14807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.836369:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910386944 00000100:00100000:0.0:1789131395.836378:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910386944 00010000:00010000:0.0:1789131395.836421:0:14776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 13 pid: 14784 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131395.836450:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131395.836458:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+13:3309:x1876039910386944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131395.836470:0:14776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131395.836475:0:14776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 13 pid: 14784 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836486:0:14776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 13 pid: 14784 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836502:0:14776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c7473f200/0x9f0de3718790557b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187905574 expref: 13 pid: 14784 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836515:0:14776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836524:0:14776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789131395.836539:0:14776:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005877902s 00010000:00010000:0.0:1789131395.836543:0:14776:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836550:0:14776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836572:0:14776:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836578:0:14776:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836584:0:14776:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131395.836587:0:14776:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836595:0:14776:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836617:0:14776:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131395.836627:0:14776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131395.836665:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3309:x1876039910386944:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131395.836672:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131395.836938:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910386944:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131395.836958:0:14807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.836966:0:14807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131395.836972:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742c4800/0x9f0de371879055ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131395.851367:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14773:x1876039910386688:12345-0@lo:253:mount.lustre.0 Request processed in 72775us (72903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131395.851397:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131395.851567:0:14773:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14773:1876039910386688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789131395.851584:0:14773:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789131395.851587:0:14773:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131395.851589:0:14773:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789131395.851590:0:14773:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131395.851591:0:14773:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131395.851592:0:14773:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131395.851593:0:14773:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131395.851595:0:14773:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789131395.851596:0:14773:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789131395.851598:0:14773:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131395.851599:0:14773:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789131395.851622:0:14773:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789131395.857926:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789131395.858086:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789131395.858390:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789131395.858539:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789131395.858803:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789131395.859199:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131395.860091:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131395.860264:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131395.860561:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131395.860780:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131395.861045:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131395.861205:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1789131395.889117:0:14773:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:1.0:1789131395.890404:0:14830:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789131395.890410:0:14830:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789131395.890433:0:14773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789131395.890746:0:14831:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789131395.890938:0:14831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789131395.893843:0:14773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789131395.894792:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789131395.895507:0:14773:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789131395.895520:0:14773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789131395.895689:0:14773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131395.896202:0:14831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789131395.896266:0:14831:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789131395.896270:0:14831:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:2.0:1789131395.897198:0:14773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789131395.897825:0:14773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789131395.897858:0:14773:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789131395.899226:0:14773:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789131395.904297:0:14773:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789131395.927784:0:14773:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789131395.927909:0:14773:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba05c1dbb988 00100000:10000000:3.0:1789131395.927927:0:14773:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789131395.928247:0:14773:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789131395.928261:0:14773:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789131395.928273:0:14773:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789131395.928288:0:14773:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789131396.442017:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131396.827403:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789131397.209932:0:14788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131397.209940:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43172000 from 6 10000000:01000000:0.0:1789131397.209945:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131397.209986:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131397.209997:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131397.210007:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131397.210031:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131397.210094:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131397.210141:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4367cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789131397.210432:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387072 00000100:00100000:1.0:1789131397.210439:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387072 00000100:00100000:1.0:1789131397.210493:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789131397.210503:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14788:x1876039910387072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131397.210516:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131397.210531:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879055b3 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131397.210553:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879055b3 expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131397.210563:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879055b3 expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131397.210572:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4c00, rc 0) 00000100:00100000:1.0:1789131397.210617:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131397.210623:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789131397.210846:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131397.210861:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131397.210870:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131397.210935:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131397.210971:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131397.211000:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4367cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131397.211114:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387200 00000100:00100000:2.0:1789131397.211119:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387200 00000100:00100000:2.0:1789131397.211157:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131397.211165:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789131397.211180:0:14785:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789131397.211194:0:14785:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789131397.211197:0:14785:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789131397.211280:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131397.211288:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131397.211344:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789131397.211386:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789131397.211393:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131397.211400:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131397.466472:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789131397.850682:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131398.489402:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131399.398855:0:15073:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789131399.517682:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131400.537516:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131401.178844:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131401.178850:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131401.178859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131401.178862:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789131401.178864:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789131401.178867:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789131401.178870:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c0c52a90000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131401.178892:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c0c52a90000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131401.178915:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d843c0 x1876039910387456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131401.179115:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910387456:0@lo:38:kworker.0 00000100:00100000:0.0:1789131401.179178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131401.179232:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131401.179240:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910387328:0@lo:400:kworker.0 00000100:00100000:0.0:1789131401.179268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131401.179301:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387328 00000100:00100000:0.0:1789131401.179307:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387328 00000100:00100000:0.0:1789131401.179374:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131401.179384:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3308:x1876039910387328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131401.179426:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3308:x1876039910387328:12345-0@lo:400:kworker.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131401.179433:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789131401.179472:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910387328:0@lo:400:kworker.0 00000100:00100000:1.0:1789131401.184116:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387456 00000100:00100000:1.0:1789131401.184131:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387456 00000100:00100000:1.0:1789131401.184167:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131401.184174:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1876039910387456:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789131401.184203:0:14793:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:1.0:1789131401.184240:0:14793:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9f0de371879055c1 00000004:00100000:1.0:1789131401.184257:0:14793:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789131401.184401:0:14793:0:(import.c:65:import_set_state_nolock()) ffff9c0c52a90800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131401.184483:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876039910387456:12345-0@lo:38:kworker.0 Request processed in 308us (5304us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131401.184490:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789131401.186491:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0b41d843c0 x1876039910387456/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789131401.186511:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789131401.186519:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789131401.186524:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789131401.186528:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c52a90000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789131401.186536:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876039910387456:0@lo:38:kworker.0 00010000:00010000:2.0:1789131401.564922:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789131402.095646:0:15223:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb598b170 20000000:00000080:2.0:1789131402.095663:0:15223:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0c764c4800 uarg=0000000000000000 20000000:01000000:2.0:1789131402.095847:0:15223:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789131402.095854:0:15223:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789131402.095859:0:15223:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789131402.096636:0:15224:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789131402.096970:0:15223:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789131402.105283:0:15223:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789131402.105312:0:15223:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.105366:0:15223:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905582 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.105375:0:15223:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.105418:0:15223:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.105434:0:15223:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 11 pid: 14785 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131402.105449:0:15223:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15223:1876039910387584:0@lo:104: 00000100:00100000:2.0:1789131402.105508:0:15223:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131402.105561:0:15223:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5094b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131402.106811:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387584 00000100:00100000:1.0:1789131402.106821:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387584 00000100:00100000:1.0:1789131402.106867:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131402.106893:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:15223:x1876039910387584:12345-0@lo:104: 00010000:00010000:1.0:1789131402.106908:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.106984:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131402.106991:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:15223:x1876039910387584:12345-0@lo:104: Request processed in 102us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131402.106998:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789131402.107019:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131402.107025:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.107033:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5200 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131402.107037:0:14779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.107046:0:14779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131402.107053:0:14779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131402.107059:0:14779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789131402.107095:0:14779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.107101:0:14779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131402.107123:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.107130:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5200/0x9f0de37187905582 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905589 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131402.107154:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131402.107156:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131402.107157:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131402.107187:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910387712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789131402.107220:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131402.107419:0:15223:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15223:1876039910387584:0@lo:104: 00010000:00010000:2.0:1789131402.107439:0:15223:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131402.108102:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387712 00000100:00100000:3.0:1789131402.108110:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387712 00010000:00010000:3.0:1789131402.108137:0:14778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 12 pid: 14785 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131402.108168:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131402.108175:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3306:x1876039910387712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131402.108186:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131402.108192:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 12 pid: 14785 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108204:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 12 pid: 14785 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108220:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c7473f800/0x9f0de37187905589 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187905582 expref: 12 pid: 14785 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108234:0:14778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108252:0:14778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108268:0:14778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108275:0:14778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108282:0:14778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108288:0:14778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108293:0:14778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131402.108297:0:14778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108305:0:14778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108346:0:14778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131402.108356:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131402.108399:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:3306:x1876039910387712:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131402.108406:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131402.108440:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910387712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131402.108692:0:15223:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.108797:0:15223:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.108804:0:15223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742b0000/0x9f0de371879055c8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15223 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131402.586378:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789131403.290624:0:14788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789131403.290634:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172000 from 13 10000000:01000000:1.0:1789131403.290640:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131403.290691:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131403.290702:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131403.290713:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131403.290737:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789131403.290806:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131403.290888:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52f619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131403.291015:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387840 00000100:00100000:0.0:1789131403.291024:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387840 00000100:00100000:0.0:1789131403.291090:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789131403.291099:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+11:14788:x1876039910387840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131403.291127:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131403.291144:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879055cf expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131403.291168:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879055cf expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131403.291179:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879055cf expref: 12 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131403.291188:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14000, rc 0) 00000100:00100000:0.0:1789131403.291241:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131403.291249:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789131403.291388:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131403.291403:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131403.291413:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131403.291483:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131403.291509:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131403.291534:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42c46cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131403.291655:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910387968 00000100:00100000:1.0:1789131403.291660:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910387968 00000100:00100000:1.0:1789131403.291684:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789131403.291691:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131403.291991:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910387968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131403.291999:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131403.292085:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910387968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131403.292118:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910388096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131403.292157:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131403.292180:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42c46cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131403.292269:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388096 00000100:00100000:0.0:1789131403.292283:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388096 00000100:00100000:0.0:1789131403.292310:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789131403.292316:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910388096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789131403.292488:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:14788:x1876039910388096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131403.292495:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789131403.292690:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910388096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789131403.294664:0:15263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789131403.301569:0:14788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789131403.301612:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789131403.301630:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131403.301639:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131403.610364:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131404.637903:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131405.273458:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131395/real 1789131395] req@ffff9c0b41d84000 x1876039910384768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131405.273489:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0b41d84000 x1876039910384768/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131405.273500:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131395/real 1789131395] req@ffff9c0c7a4252c0 x1876039910384640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131405 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131405.273521:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0c7a4252c0 x1876039910384640/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131405 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789131405.273540:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131405.273566:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131405.273570:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910384768:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789131405.273577:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c80d4a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131405.273584:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131405.273587:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910384640:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789131405.274078:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131405.274084:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789131405.274093:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c0c80d4a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131405.274098:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789131405.274104:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789131405.274111:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c0c80d4a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131405.274133:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a63c3c0 x1876039910388352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131405.274263:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789131405.274267:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789131405.274269:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789131405.274273:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 407 00000100:00080000:3.0:1789131405.274276:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789131405.274280:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0c43e94800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131405.274296:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a63e580 x1876039910388480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789131405.274368:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131405.274382:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910388224:0@lo:400:kworker.0 00000100:00100000:2.0:1789131405.274396:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910388608:0@lo:400:kworker.0 00000100:00100000:2.0:1789131405.274460:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131405.274539:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388608 00000100:00100000:0.0:1789131405.274541:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910388352:0@lo:8:kworker.0 00000100:00100000:2.0:1789131405.274547:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388608 00000400:00000100:0.0:1789131405.274573:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039910388352 offset 0 length 520: 4 00000100:00100000:2.0:1789131405.274596:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131405.274602:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910388480:0@lo:8:kworker.0 00000100:00100000:2.0:1789131405.274608:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910388608:12345-0@lo:400:kworker.0 00000400:00000100:0.0:1789131405.274622:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876039910388480 offset 0 length 520: 4 00010000:00080000:0.0:1789131405.274698:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0c7a63fc00 x1876039910388608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131421 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131405.274710:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910388608:0@lo:400:kworker.0 00000100:00100000:2.0:1789131405.274789:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910388608:12345-0@lo:400:kworker.0 Request processed in 182us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131405.274797:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789131405.274901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131405.275222:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388224 00000100:00100000:0.0:1789131405.275228:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388224 00000100:00100000:0.0:1789131405.275266:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789131405.275274:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3306:x1876039910388224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131405.275335:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:3306:x1876039910388224:12345-0@lo:400:kworker.0 Request processed in 47us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131405.275345:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789131405.275371:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910388224:0@lo:400:kworker.0 00010000:00010000:1.0:1789131405.658700:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131406.681552:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789131407.071262:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789131407.706076:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789131407.950482:0:15474:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789131407.950488:0:15474:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789131407.950757:0:15474:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0c43123000 00000020:01000004:3.0:1789131407.950780:0:15474:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789131407.950795:0:15474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789131407.950812:0:15474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c0c492c0000) 00000020:00000080:3.0:1789131407.950842:0:15474:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789131408.082881:0:15474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789131408.083172:0:15474:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789131408.089119:0:15474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789131408.089787:0:15474:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789131408.090739:0:15474:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789131408.091576:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:1.0:1789131408.091737:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:1.0:1789131408.091845:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:1.0:1789131408.099433:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1789131408.101660:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:1.0:1789131408.102024:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1789131408.103779:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 769: rc = 0 00100000:10000000:1.0:1789131408.104908:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 769: rc = 0 00100000:10000000:1.0:1789131408.108813:0:15474:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 769: rc = 0 00000020:00000080:1.0:1789131408.110097:0:15474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789131408.110114:0:15474:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789131408.110128:0:15474:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9f0de371879055e4 00000020:01000004:1.0:1789131408.110137:0:15474:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789131408.111395:0:15474:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789131408.111402:0:15474:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789131408.111413:0:15474:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789131408.111421:0:15474:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789131408.111442:0:15474:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c0c772b0000) 00000020:00000080:1.0:1789131408.111458:0:15474:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:1.0:1789131408.121873:0:15474:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789131408.122149:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789131408.122158:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789131408.131991:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789131408.132007:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789131408.137760:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789131408.137773:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1789131408.139400:0:15474:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131408.139609:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1789131408.139616:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789131408.140498:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789131408.140505:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789131408.160418:0:15474:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789131408.160699:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789131408.160707:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789131408.162149:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789131408.162160:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789131408.163213:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789131408.163222:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789131408.165196:0:15474:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131408.165403:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789131408.165409:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789131408.166043:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789131408.166051:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789131408.196011:0:15474:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789131408.196319:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789131408.196371:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789131408.198785:0:15474:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789131408.198799:0:15474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789131408.199733:0:15474:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789131408.199756:0:15474:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789131408.199762:0:15474:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789131408.212042:0:15474:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789131408.212088:0:15474:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789131408.212094:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789131408.212096:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789131408.212097:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131408.212098:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131408.212100:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131408.212101:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131408.212102:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131408.212104:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131408.212105:0:15474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789131408.212109:0:15474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789131408.212111:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789131408.212113:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789131408.212114:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131408.212121:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131408.212122:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131408.212123:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131408.212124:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131408.212125:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131408.212126:0:15474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789131408.212155:0:15474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789131408.212176:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388736:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789131408.212252:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.212414:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42c8e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131408.212537:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388736 00000100:00100000:1.0:1789131408.212547:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388736 00000100:00100000:1.0:1789131408.212629:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131408.212639:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:15474:x1876039910388736:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789131408.212666:0:14786:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789131408.212669:0:14786:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789131408.212672:0:14786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789131408.218034:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:15474:x1876039910388736:12345-0@lo:253:mount.lustre.0 Request processed in 5390us (5774us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.218049:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789131408.218191:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388736:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789131408.218207:0:15474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789131408.218210:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789131408.218212:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789131408.218213:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789131408.218214:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789131408.218216:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789131408.218217:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789131408.218219:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789131408.218221:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789131408.218222:0:15474:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789131408.218252:0:15474:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0c43123000 from lustre-OST0000 10000000:01000000:1.0:1789131408.218278:0:15474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1789131408.218281:0:15474:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789131408.218288:0:15474:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c0c772b4ed8 local copy 00010000:00010000:1.0:1789131408.218298:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131408.218692:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388864:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131408.218724:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.218759:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55961c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789131408.218808:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388864 00000100:00100000:3.0:1789131408.218814:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388864 00000100:00100000:3.0:1789131408.218912:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789131408.218923:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:15474:x1876039910388864:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131408.219115:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:15474:x1876039910388864:12345-0@lo:501:mount.lustre.0 Request processed in 193us (387us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789131408.219124:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789131408.219219:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388864:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789131408.219236:0:15474:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789131408.219451:0:15474:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789131408.219467:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.219478:0:15474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131408.219504:0:15474:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0c43123000 10000000:01000000:1.0:1789131408.219516:0:15474:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789131408.219523:0:15474:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c0c772b4ed8 10000000:01000000:1.0:1789131408.219527:0:15474:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789131408.219532:0:15474:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c0c772b4ed8 from 1 10000000:01000000:1.0:1789131408.219535:0:15474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789131408.219563:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.219571:0:15474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.219581:0:15474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131408.219593:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388992:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131408.219621:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.219657:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55961c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.219763:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910388992 00000100:00100000:0.0:1789131408.219768:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910388992 00000100:00100000:0.0:1789131408.219793:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789131408.219800:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+12:15474:x1876039910388992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131408.219809:0:14786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131408.219820:0:14786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879055f9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879055f2 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.219851:0:14786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879055f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879055f2 expref: 13 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.219864:0:14786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15a00/0x9f0de371879055f9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879055f2 expref: 13 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.219873:0:14786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15a00, rc 0) 00000100:00100000:0.0:1789131408.220066:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+13:15474:x1876039910388992:12345-0@lo:101:mount.lustre.0 Request processed in 265us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.220073:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789131408.220137:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910388992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131408.220150:0:15474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055f9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.220161:0:15474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879055f9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131408.220182:0:15474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789131408.220195:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055f9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.220202:0:15474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4200/0x9f0de371879055f2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879055f9 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131408.220209:0:15474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789131408.220213:0:15474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789131408.220218:0:15474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789131408.220220:0:15474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789131408.220234:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.220242:0:15474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.220249:0:15474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131408.220261:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389120:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131408.220285:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.220306:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55961c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.220461:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389120 00000100:00100000:2.0:1789131408.220467:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389120 00000100:00100000:2.0:1789131408.220501:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789131408.220509:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+13:15474:x1876039910389120:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131408.220517:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131408.220528:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b0400/0x9f0de37187905607 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905600 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.220544:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b0400/0x9f0de37187905607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905600 expref: 14 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.220554:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b0400/0x9f0de37187905607 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905600 expref: 14 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.220572:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0400, rc 0) 00000100:00100000:2.0:1789131408.220604:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389120:12345-0@lo:101:mount.lustre.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.220621:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789131408.221167:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389120:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131408.221185:0:15474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905607 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.221194:0:15474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905607 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131408.221958:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789131408.222760:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131408.223015:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789131408.223073:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789131408.223102:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789131408.223142:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789131408.223173:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789131408.223201:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789131408.223271:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789131408.223279:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789131408.223391:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131408.223454:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.223500:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789131408.224004:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389248 00000100:00100000:3.0:1789131408.224011:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389248 00000100:00100000:3.0:1789131408.224067:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789131408.224078:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389248:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131408.224437:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389248:12345-0@lo:501:mount.lustre.0 Request processed in 361us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131408.224457:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789131408.224624:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131408.224775:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131408.224816:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.224885:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.224916:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389376 00000100:00100000:0.0:1789131408.224920:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389376 00000100:00100000:0.0:1789131408.224954:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131408.225202:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131408.226181:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389376:12345-0@lo:503:mount.lustre.0 Request processed in 974us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131408.226195:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789131408.226295:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131408.227933:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131408.228035:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131408.228119:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.228227:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.228270:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389504 00000100:00100000:2.0:1789131408.228277:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389504 00000100:00100000:2.0:1789131408.228489:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789131408.228500:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389504:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131408.228762:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389504:12345-0@lo:502:mount.lustre.0 Request processed in 263us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.228769:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789131408.228857:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131408.229091:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789131408.229141:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789131408.229168:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789131408.229207:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789131408.229245:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789131408.229276:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789131408.229313:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789131408.229375:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789131408.229403:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789131408.229454:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789131408.229482:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789131408.229518:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789131408.229545:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131408.229580:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.229619:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a15e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.229649:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389632 00000100:00100000:2.0:1789131408.229656:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389632 00000100:00100000:2.0:1789131408.229701:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789131408.229709:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131408.229875:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389632:12345-0@lo:502:mount.lustre.0 Request processed in 166us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.229883:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789131408.229912:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131408.229968:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789131408.229976:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789131408.230825:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789131408.230843:0:15488:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789131408.230850:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131408.230852:0:15488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789131408.230857:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131408.230871:0:15488:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c0c772b3490) 00000020:00000080:1.0:1789131408.230890:0:15488:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789131408.230894:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789131408.230949:0:15488:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43123000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789131408.230956:0:15488:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789131408.230961:0:15488:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9f0de37187905615 00010000:00010000:1.0:1789131408.234377:0:15488:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789131408.234780:0:15488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789131408.236091:0:15488:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:3.0:1789131408.237378:0:15488:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789131408.237389:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.237395:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237397:0:15488:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789131408.237401:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789131408.237403:0:15488:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789131408.237404:0:15488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789131408.237405:0:15488:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789131408.237414:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789131408.237416:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237418:0:15488:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789131408.237420:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.237422:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237424:0:15488:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789131408.237426:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789131408.237428:0:15488:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789131408.237431:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.237433:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237434:0:15488:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789131408.237436:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.237438:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237439:0:15488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789131408.237442:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789131408.237473:0:15488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.237475:0:15488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.237476:0:15488:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789131408.237479:0:15488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1789131408.237615:0:15474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1789131408.237691:0:15474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789131408.237710:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905607 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.237721:0:15474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5c00/0x9f0de37187905600 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905607 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131408.237728:0:15474:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43123000 from 1 10000000:01000000:1.0:1789131408.237730:0:15474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131408.237763:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.237769:0:15474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131408.237780:0:15474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131408.237802:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389760:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131408.237873:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.237904:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42bd1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.239547:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389760 00000100:00100000:0.0:1789131408.239559:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389760 00000100:00100000:0.0:1789131408.239605:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789131408.239613:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+14:15474:x1876039910389760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131408.239629:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131408.239704:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790561c expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.239734:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790561c expref: 15 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.239744:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790561c expref: 15 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.239753:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e15800, rc 0) 00000100:00100000:0.0:1789131408.239826:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910389760:12345-0@lo:101:mount.lustre.0 Request processed in 214us (1952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.239843:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789131408.239990:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131408.240011:0:15474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.240019:0:15474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131408.240581:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789131408.241044:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131408.241240:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789131408.241276:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789131408.243436:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789131408.243465:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789131408.243567:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131408.243630:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131408.244523:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c52f61300 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.246001:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910389888 00000100:00100000:0.0:1789131408.246012:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910389888 00000100:00100000:0.0:1789131408.246057:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789131408.246065:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910389888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131408.246438:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910389888:12345-0@lo:501:mount.lustre.0 Request processed in 373us (2805us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.246451:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789131408.247929:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910389888:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131408.247986:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390016:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131408.248043:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131408.248088:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51fddf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789131408.248576:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390016 00000100:00100000:1.0:1789131408.248586:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390016 00000100:00100000:1.0:1789131408.248646:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789131408.248657:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131408.248936:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390016:12345-0@lo:503:mount.lustre.0 Request processed in 280us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131408.248946:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789131408.249085:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390016:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789131408.249691:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789131408.249767:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131408.250086:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131408.250122:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51fddf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.250283:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390144 00000100:00100000:0.0:1789131408.250288:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390144 00000100:00100000:0.0:1789131408.250349:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789131408.250356:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131408.250538:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390144:12345-0@lo:502:mount.lustre.0 Request processed in 182us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.250544:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789131408.250719:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789131408.250983:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789131408.251035:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789131408.251078:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789131408.251109:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789131408.251149:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789131408.251190:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789131408.251220:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789131408.251247:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789131408.251287:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789131408.251465:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789131408.251522:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:3.0:1789131408.251554:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390272:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131408.251594:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131408.251629:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c51fddf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.251721:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390272 00000100:00100000:2.0:1789131408.251726:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390272 00000100:00100000:2.0:1789131408.251765:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789131408.251772:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131408.251939:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390272:12345-0@lo:502:mount.lustre.0 Request processed in 167us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.251946:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789131408.252035:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390272:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789131408.252090:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:3.0:1789131408.252098:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1789131408.252883:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.252892:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.252894:0:15492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789131408.252900:0:15492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43123000 00000020:00000080:3.0:1789131408.252902:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131408.252910:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.252912:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.252913:0:15492:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789131408.252915:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.252917:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.252918:0:15492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789131408.252921:0:15492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c43123000 00000020:00000080:3.0:1789131408.252924:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131408.252978:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.252981:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.252988:0:15492:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789131408.252990:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.252993:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.252994:0:15492:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131408.252997:0:15492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43123000 00000020:00000080:3.0:1789131408.252999:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131408.253016:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.253018:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.253019:0:15492:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789131408.253022:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789131408.253023:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.253025:0:15492:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789131408.253027:0:15492:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c43123000 00000020:00000080:3.0:1789131408.253029:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789131408.253059:0:15492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789131408.253062:0:15492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789131408.253063:0:15492:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789131408.253065:0:15492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1789131408.253198:0:15474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1789131408.253217:0:15474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789131408.253235:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.253245:0:15474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131408.253283:0:15474:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789131408.253286:0:15474:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0c43123000 10000000:01000000:0.0:1789131408.253288:0:15474:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0c43123000 10000000:01000000:0.0:1789131408.253292:0:15474:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789131408.253297:0:15474:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c43123000 from 1 10000000:01000000:0.0:1789131408.253299:0:15474:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789131408.253344:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.253351:0:15474:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.253360:0:15474:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131408.253383:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789131408.253426:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.253444:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.253529:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390400 00000100:00100000:2.0:1789131408.253534:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390400 00000100:00100000:2.0:1789131408.253573:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789131408.253580:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910390400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131408.253592:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131408.253604:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b1600/0x9f0de37187905631 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790562a expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.253624:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b1600/0x9f0de37187905631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790562a expref: 16 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.253730:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b1600/0x9f0de37187905631 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790562a expref: 16 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.253739:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1600, rc 0) 00000100:00100000:2.0:1789131408.253776:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390400:12345-0@lo:101:mount.lustre.0 Request processed in 196us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.253782:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789131408.254860:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131408.254880:0:15474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905631 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.254890:0:15474:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905631 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131408.255426:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789131408.256023:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789131408.256250:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789131408.256287:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789131408.256311:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789131408.256520:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789131408.256552:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789131408.256589:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789131408.256615:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789131408.256651:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789131408.256688:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789131408.256714:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789131408.256738:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789131408.256771:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789131408.256797:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789131408.256821:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789131408.256870:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789131408.256896:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789131408.256920:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789131408.256975:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789131408.257003:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789131408.257041:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789131408.257077:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789131408.257103:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789131408.257127:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789131408.257160:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789131408.257186:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789131408.257210:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789131408.257244:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789131408.257270:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789131408.257354:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789131408.257361:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789131408.257455:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131408.257523:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.257574:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390528 00000100:00100000:0.0:1789131408.257579:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390528 00000100:00100000:0.0:1789131408.257621:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789131408.257628:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131408.257821:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390528:12345-0@lo:501:mount.lustre.0 Request processed in 193us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.257842:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789131408.257877:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.257895:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131408.257921:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131408.257951:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.257963:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d180 going to sleep for 11 seconds 00000100:00100000:2.0:1789131408.258026:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390656 00000100:00100000:2.0:1789131408.258030:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390656 00000100:00100000:2.0:1789131408.258057:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789131408.258063:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131408.258176:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390656:12345-0@lo:503:mount.lustre.0 Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.258182:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789131408.258471:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789131408.260246:0:15474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789131408.260341:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131408.260406:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.260440:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131408.260504:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390784 00000100:00100000:1.0:1789131408.260510:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390784 00000100:00100000:1.0:1789131408.260546:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789131408.260553:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131408.260754:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390784:12345-0@lo:502:mount.lustre.0 Request processed in 201us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131408.260762:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789131408.261763:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789131408.262027:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789131408.262074:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789131408.262100:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789131408.262146:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789131408.262174:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789131408.262209:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789131408.262236:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789131408.262261:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789131408.262294:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789131408.262343:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789131408.262375:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789131408.262414:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789131408.262442:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789131408.262468:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789131408.262504:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789131408.262531:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789131408.262557:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789131408.262593:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789131408.262620:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789131408.262723:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789131408.262765:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789131408.262792:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789131408.262818:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789131408.262879:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789131408.262910:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789131408.262944:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789131408.262989:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789131408.263018:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789131408.263041:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789131408.263076:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789131408.263102:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789131408.263126:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789131408.263151:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789131408.263183:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789131408.263209:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789131408.263265:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789131408.263294:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789131408.263317:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789131408.263383:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789131408.263411:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789131408.263453:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131408.263527:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.263564:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789131408.264673:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910390912 00000100:00100000:1.0:1789131408.264683:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910390912 00000100:00100000:1.0:1789131408.264729:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789131408.264737:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131408.264980:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910390912:12345-0@lo:502:mount.lustre.0 Request processed in 243us (1452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131408.264988:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789131408.265914:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910390912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789131408.266023:0:15474:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789131408.266037:0:15474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789131408.274232:0:15495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789131408.274250:0:15495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c0c492c3490) 00000020:00000080:3.0:1789131408.274275:0:15495:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789131408.274479:0:15495:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c43123000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131408.274485:0:15495:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c43123000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789131408.274488:0:15495:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c43123000 3 00010000:00080000:3.0:1789131408.274536:0:15495:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0b4270a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1789131408.276361:0:15495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789131408.276615:0:15495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789131408.276653:0:15495:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789131408.276663:0:15495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9f0de3718790563f 00000100:00080000:3.0:1789131408.276672:0:15495:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789131408.276678:0:15495:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c0b4270a000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1789131408.276711:0:15495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a63cb40 x1876039910391040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789131408.276749:0:15495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789131408.277765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910391040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789131408.277841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789131408.277899:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131408.277904:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789131408.277906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789131408.277910:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789131408.277954:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391040 00000100:00100000:0.0:1789131408.277964:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391040 00000100:00100000:0.0:1789131408.277991:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131408.277997:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910391040:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789131408.278018:0:14791:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:0.0:1789131408.278058:0:14791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9f0de37187905646 00000004:00100000:0.0:1789131408.278073:0:14791:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789131408.278102:0:14791:0:(import.c:65:import_set_state_nolock()) ffff9c0c52a97800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131408.278146:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876039910391040:12345-0@lo:38:llog_process_th.0 Request processed in 148us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.278153:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131408.278177:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910391168:0@lo:400:kworker.0 00000100:00100000:0.0:1789131408.278198:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131408.278725:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391168 00000100:00100000:3.0:1789131408.278730:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391168 00000100:00100000:3.0:1789131408.278761:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789131408.278768:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910391168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131408.278808:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910391168:12345-0@lo:400:kworker.0 Request processed in 41us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131408.278814:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789131408.279430:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0c7a63cb40 x1876039910391040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131408.279442:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131408.279451:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789131408.279521:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789131408.279527:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789131408.279530:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0b4270a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789131408.279538:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1876039910391040:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789131408.279575:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c0b42cf2d00 x1876039910391168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131408.279586:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910391168:0@lo:400:kworker.0 00000040:00080000:2.0:1789131408.286564:0:15495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789131408.288491:0:15474:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789131408.288537:0:15474:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789131408.288559:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905631 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131408.288571:0:15474:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14a00/0x9f0de3718790562a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905631 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789131408.288643:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789131408.288646:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131408.288648:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131408.288649:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131408.288650:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131408.288657:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131408.288659:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131408.288661:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131408.288663:0:15474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131408.288667:0:15474:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789131408.288670:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131408.288671:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789131408.288672:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131408.288673:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131408.288674:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131408.288675:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131408.288676:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131408.288677:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131408.288678:0:15474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131408.288701:0:15474:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789131408.288722:0:15474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910391296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131408.288802:0:15474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131408.288855:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391296 00000100:00100000:2.0:1789131408.288859:0:15474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c42c469c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131408.288863:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391296 00000100:00100000:1.0:1789131408.288910:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789131408.288918:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:15474:x1876039910391296:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789131408.288940:0:14784:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789131408.288952:0:14784:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789131408.329660:0:14784:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789131408.329723:0:14807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789131408.329732:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789131408.329768:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.329785:0:14807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879055b3 expref: 16 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.329794:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.329840:0:14807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 16 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.329854:0:14807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 16 pid: 14784 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131408.329868:0:14807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910391424:0@lo:104: 00000100:00100000:0.0:1789131408.329925:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.329963:0:14807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47e4d000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131408.329989:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391424 00000100:00100000:0.0:1789131408.329995:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391424 00000100:00100000:0.0:1789131408.330030:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131408.330037:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910391424:12345-0@lo:104: 00010000:00010000:0.0:1789131408.330048:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330089:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789131408.330095:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910391424:12345-0@lo:104: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.330101:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789131408.330121:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131408.330132:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330139:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:0.0:1789131408.330143:0:14780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330151:0:14780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789131408.330158:0:14780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789131408.330164:0:14780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789131408.330187:0:14780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330192:0:14780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789131408.330208:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330215:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de371879055b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055ba expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330229:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131408.330230:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131408.330232:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131408.330249:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910391552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131408.330271:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131408.330346:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391552 00000100:00100000:0.0:1789131408.330353:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391552 00010000:00010000:0.0:1789131408.330368:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 17 pid: 14784 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131408.330386:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131408.330392:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:3306:x1876039910391552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131408.330400:0:14777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131408.330405:0:14777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 17 pid: 14784 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330414:0:14777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 17 pid: 14784 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330428:0:14777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330436:0:14777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789131408.330448:0:14777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005877902s 00010000:00010000:0.0:1789131408.330451:0:14777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330457:0:14777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330463:0:14777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330470:0:14777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330483:0:14777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131408.330487:0:14777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330494:0:14777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330506:0:14777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330514:0:14777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131408.330543:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:3306:x1876039910391552:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131408.330549:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789131408.330583:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910391552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789131408.330604:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742c4c00/0x9f0de371879055ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879055b3 expref: 16 pid: 14784 timeout: 520 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131408.330613:0:14807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910391424:0@lo:104: 00010000:00010000:0.0:1789131408.330622:0:14807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330631:0:14807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330637:0:14807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131408.330657:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15e00/0x9f0de3718790564d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789131408.330697:0:14784:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789131408.341693:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:15474:x1876039910391296:12345-0@lo:253:mount.lustre.0 Request processed in 52768us (52883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131408.341708:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789131408.342000:0:15474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:15474:1876039910391296:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789131408.342015:0:15474:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789131408.342018:0:15474:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789131408.342020:0:15474:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789131408.342021:0:15474:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131408.342023:0:15474:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131408.342024:0:15474:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131408.342025:0:15474:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131408.342027:0:15474:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131408.342028:0:15474:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131408.342029:0:15474:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789131408.342043:0:15474:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789131408.346119:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131408.346291:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131408.346500:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131408.346729:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789131408.347147:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:0.0:1789131408.347269:0:15474:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789131408.348194:0:15474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789131408.381014:0:15474:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789131408.381022:0:15474:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789131408.381064:0:15474:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789131408.381144:0:15474:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789131408.381163:0:15474:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1789131408.381188:0:15474:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789131408.731557:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131409.758564:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789131409.881405:0:14788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789131409.881412:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43172000 from 7 10000000:01000000:0.0:1789131409.881429:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789131409.881486:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131409.881498:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131409.881510:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131409.881545:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910391680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789131409.881612:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131409.881794:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43091840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131409.881993:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391680 00000100:00100000:1.0:1789131409.882000:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391680 00000100:00100000:1.0:1789131409.882049:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789131409.882059:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+15:14788:x1876039910391680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131409.882072:0:14786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131409.882086:0:14786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905654 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131409.882122:0:14786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905654 expref: 16 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131409.882133:0:14786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905654 expref: 16 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131409.882142:0:14786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5e00, rc 0) 00000100:00100000:1.0:1789131409.882190:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:14788:x1876039910391680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131409.882197:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789131409.882753:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910391680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789131409.882768:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131409.882778:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131409.882843:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910391808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789131409.882874:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131409.882903:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43091840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131409.883019:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391808 00000100:00100000:2.0:1789131409.883024:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391808 00000100:00100000:2.0:1789131409.883060:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789131409.883068:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:14788:x1876039910391808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789131409.883083:0:14784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789131409.883108:0:14784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789131409.883111:0:14784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789131409.883199:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:14788:x1876039910391808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131409.883212:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789131409.883754:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910391808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789131409.883815:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789131409.883836:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131409.883845:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131410.780669:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131411.806040:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131412.826207:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131413.465522:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131413.465530:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131413.465533:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131413.465537:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789131413.465649:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131413.465671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a426580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910391936:0@lo:400:kworker.0 00000100:00100000:0.0:1789131413.465742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131413.465809:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910392064:0@lo:400:kworker.0 00000100:00100000:0.0:1789131413.465846:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131413.465869:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131413.465875:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910392192:0@lo:400:kworker.0 00000100:00100000:0.0:1789131413.465898:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131413.465929:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392064 00000100:00100000:0.0:1789131413.465933:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910391936 00000100:00100000:1.0:1789131413.465938:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392064 00000100:00100000:0.0:1789131413.465939:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910391936 00000100:00100000:0.0:1789131413.465987:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789131413.465988:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392192 00000100:00100000:1.0:1789131413.465994:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392192 00000100:00100000:0.0:1789131413.466000:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3306:x1876039910391936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131413.466032:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131413.466042:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910392064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131413.466055:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3306:x1876039910391936:12345-0@lo:400:kworker.0 Request processed in 57us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131413.466065:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789131413.466097:0:14793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789131413.466104:0:14793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789131413.466120:0:14791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789131413.466127:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131413.466134:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910392192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131413.466167:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910392192:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131413.466173:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789131413.466348:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a424b40 x1876039910392192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131413.466369:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910392192:0@lo:400:kworker.0 00000100:00080000:3.0:1789131413.466391:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131413.466402:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a426580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910391936:0@lo:400:kworker.0 00000100:00100000:1.0:1789131413.466527:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910392064:12345-0@lo:400:kworker.0 Request processed in 487us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131413.466535:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789131413.466580:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a427480 x1876039910392064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131413.466592:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910392064:0@lo:400:kworker.0 00010000:00010000:2.0:1789131413.849574:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131414.873499:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131415.512503:0:15842:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789131415.902267:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131416.927989:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131417.306985:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789131417.948939:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789131418.587815:0:15233:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131418.587822:0:15233:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789131418.587825:0:15233:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131418.587828:0:15233:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789131418.587894:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910392320:0@lo:400:kworker.0 00000100:00100000:2.0:1789131418.587959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131418.588005:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131418.588011:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910392448:0@lo:400:kworker.0 00000100:00100000:2.0:1789131418.588038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131418.588064:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789131418.588071:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910392576:0@lo:400:kworker.0 00000100:00100000:2.0:1789131418.588098:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131418.588124:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392448 00000100:00100000:2.0:1789131418.588130:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392448 00000100:00100000:2.0:1789131418.588169:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392576 00000100:00100000:2.0:1789131418.588173:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392576 00000100:00100000:2.0:1789131418.588202:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131418.588222:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910392448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131418.588273:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910392448:12345-0@lo:400:kworker.0 Request processed in 52us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131418.588281:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789131418.588298:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131418.588305:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910392576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131418.588354:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910392576:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131418.588361:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789131418.588646:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a427840 x1876039910392576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131418.588660:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910392576:0@lo:400:kworker.0 00010000:00080000:2.0:1789131418.588687:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a426d00 x1876039910392448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131418.588696:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a426d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910392448:0@lo:400:kworker.0 00000100:00100000:1.0:1789131418.588968:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392320 00000100:00100000:1.0:1789131418.588980:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392320 00000100:00100000:1.0:1789131418.589007:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789131418.589013:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3306:x1876039910392320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131418.589054:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3306:x1876039910392320:12345-0@lo:400:kworker.0 Request processed in 41us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131418.589060:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789131418.589097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910392320:0@lo:400:kworker.0 00000100:00080000:3.0:1789131418.589549:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789131418.975019:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131419.993649:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131420.579423:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131405/real 1789131405] req@ffff9c0c7a63c3c0 x1876039910388352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131420.579466:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0c7a63c3c0 x1876039910388352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131420.579478:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789131405/real 1789131405] req@ffff9c0c7a63e580 x1876039910388480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131420 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131420.579491:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c0c7a63e580 x1876039910388480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789131420 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789131420.579518:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c80d4a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131420.579571:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131420.579576:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910388352:0@lo:8:kworker.0 00000100:00080000:0.0:1789131420.579583:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131420.579590:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789131420.579593:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910388480:0@lo:8:kworker.0 00000100:00080000:1.0:1789131420.579704:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131420.579709:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789131420.579713:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c0c80d4a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131420.579719:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789131420.579726:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131420.579734:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c0c80d4a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131420.579763:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910392704:0@lo:400:kworker.0 00000100:00100000:1.0:1789131420.579776:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d84f00 x1876039910392832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789131420.579805:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131420.579809:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789131420.579811:0:38:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131420.579815:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 417 00000100:00080000:1.0:1789131420.579818:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789131420.579822:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0c43e94800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131420.579836:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d86d00 x1876039910392960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789131420.579858:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131420.579904:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910393088:0@lo:400:kworker.0 00000100:00100000:1.0:1789131420.579950:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131420.579989:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131420.579996:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910393216:0@lo:400:kworker.0 00000100:00100000:0.0:1789131420.580023:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392704 00000100:00100000:1.0:1789131420.580028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131420.580033:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392704 00000100:00100000:1.0:1789131420.580067:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393088 00000100:00100000:1.0:1789131420.580072:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393088 00000100:00100000:0.0:1789131420.580097:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789131420.580111:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3309:x1876039910392704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131420.580113:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393216 00000100:00100000:1.0:1789131420.580118:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393216 00000100:00100000:1.0:1789131420.580166:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131420.580177:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3309:x1876039910392704:12345-0@lo:400:kworker.0 Request processed in 68us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131420.580178:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910393088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131420.580193:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789131420.580232:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910393088:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131420.580241:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131420.580253:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910392704:0@lo:400:kworker.0 00000100:00100000:1.0:1789131420.580260:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131420.580269:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910393216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131420.580277:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910392832:0@lo:8:kworker.0 00000100:00100000:0.0:1789131420.580317:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131420.580372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910392960:0@lo:8:kworker.0 00000100:00100000:0.0:1789131420.580394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131420.580530:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910393216:12345-0@lo:400:kworker.0 Request processed in 42us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131420.580537:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789131420.580566:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131420.580596:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392832 00000100:00100000:1.0:1789131420.580600:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392832 00000100:00100000:1.0:1789131420.580621:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910392960 00000100:00100000:1.0:1789131420.580624:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910392960 00000100:00100000:1.0:1789131420.580632:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131420.580636:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876039910392832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789131420.580662:0:15477:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 432 last 0 00000020:00000080:1.0:1789131420.580696:0:15477:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de37187905662 00002000:00100000:1.0:1789131420.580723:0:15477:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c0c819ef800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1789131420.580728:0:15477:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1789131420.580731:0:15477:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00080000:2.0:1789131420.581186:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0b41d87840 x1876039910393216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131420.581201:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910393216:0@lo:400:kworker.0 00010000:00080000:2.0:1789131420.581221:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0b41d870c0 x1876039910393088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131420.581231:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910393088:0@lo:400:kworker.0 00002000:00080000:1.0:1789131420.582106:0:15477:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789131420.582206:0:15477:0:(import.c:65:import_set_state_nolock()) ffff9c0c819ec800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131420.582301:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876039910392832:12345-0@lo:8:kworker.0 Request processed in 1662us (1982us total) trans 0 rc 0/0 00010000:00080000:0.0:1789131420.582452:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0b41d84f00 x1876039910392832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131420.582464:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789131420.582472:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789131420.582481:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789131420.582487:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789131420.582490:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c80d4a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789131420.582559:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789131420.582565:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910392832:0@lo:8:kworker.0 00000004:00080000:2.0:1789131420.582586:0:14813:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789131420.582653:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131420.582688:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131420.582694:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876039910392960:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789131420.582713:0:15477:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789131420.582758:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1876039910392960:12345-0@lo:8:kworker.0 Request processed in 63us (2363us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789131420.582764:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:2.0:1789131420.583561:0:14813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 432557237454ns, next at 0ns, rc = 0 00000100:00080000:0.0:1789131420.584841:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789131420.584854:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789131420.584858:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910392960:0@lo:8:kworker.0 00000004:00080000:3.0:1789131420.585528:0:14814:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1789131420.585640:0:14814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14814:1876039910393472:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789131420.585706:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789131420.585726:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910393344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131420.585736:0:14814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131420.585780:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131420.585791:0:14814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4301ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131420.585847:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393344 00000100:00100000:0.0:1789131420.585854:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393344 00000100:00100000:0.0:1789131420.585934:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789131420.585947:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910393344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789131420.585987:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131420.586036:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1876039910393344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131420.586044:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789131420.586072:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789131420.586101:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a63e580 x1876039910393344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789131420.586123:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910393344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131420.586236:0:15475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393472 00000100:00100000:3.0:1789131420.586242:0:15475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393472 00000100:00100000:3.0:1789131420.586360:0:15475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131420.586370:0:15475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14814:x1876039910393472:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1789131420.590535:0:15475:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789131420.590553:0:15475:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789131420.590559:0:15475:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1789131420.602034:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.602054:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602088:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.602093:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.602101:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602122:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602134:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602142:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602162:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789131420.602900:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.602908:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602919:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.602923:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.602928:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602940:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602962:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602969:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.602987:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789131420.607087:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.607105:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.607127:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.607133:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.607141:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.607160:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.607173:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.607183:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.607209:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789131420.609371:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.609389:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.609411:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.609417:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.609424:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.609441:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.609453:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.609462:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.609474:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789131420.610009:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.610017:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610029:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.610039:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.610044:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610057:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610066:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610075:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610084:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789131420.610632:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.610640:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610651:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.610656:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.610661:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610672:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610682:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610696:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.610707:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789131420.612035:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.612048:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.612064:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.612069:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.612075:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.612090:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.612101:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.612110:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.612121:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789131420.613389:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789131420.613403:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.613417:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.613422:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.613434:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.613463:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.613924:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.613934:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.613954:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.613960:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.613967:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.613982:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.613993:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614002:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614013:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789131420.614310:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073351f76/0x9f0de37187905669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.614592:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.614600:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614609:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.614614:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131420.614618:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789131420.614620:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614625:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614638:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614639:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.614647:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614659:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614667:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614677:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614679:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.614697:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789131420.614697:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bee529e0/0x9f0de37187905670 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614716:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789131420.614721:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614727:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.614777:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614789:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614802:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.614811:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e01f8af/0x9f0de37187905677 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.615161:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.615169:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.615179:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.615183:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.615188:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.615200:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.615209:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.615218:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.615241:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:0.0:1789131420.615367:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789131420.615373:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615381:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fc00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.615386:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615395:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615409:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615417:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000012c70c5/0x9f0de3718790567e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615441:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789131420.615446:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615453:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ee00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.615457:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615466:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615479:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615486:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000364dad2f/0x9f0de37187905685 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615501:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789131420.615505:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615511:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ea00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.615515:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615537:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615549:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615557:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce8e0ac0/0x9f0de3718790568c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615571:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789131420.615575:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615582:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.615586:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615594:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615606:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615614:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eae28ef1/0x9f0de37187905693 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615642:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789131420.615646:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615654:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.615657:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615666:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615719:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.615727:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005850d692/0x9f0de3718790569a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616175:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131420.616182:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616190:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.616194:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616214:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616226:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616233:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000872a1778/0x9f0de371879056a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616247:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.616250:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616255:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.616258:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616266:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616275:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616281:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f507279/0x9f0de371879056a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.616307:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131420.616307:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.616310:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.616315:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.616318:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.616354:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.616358:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.616364:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.616379:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.616389:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.616399:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.616421:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131420.616691:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.616696:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616704:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.616709:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616717:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616728:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616735:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088804efb/0x9f0de371879056af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.616760:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.616762:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.616764:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131420.618003:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.618014:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.618030:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.618042:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.618050:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.618065:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.618076:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.618086:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.618115:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131420.619347:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.619361:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.619389:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.619394:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.619407:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.619434:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.619444:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe3d0653/0x9f0de371879056b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.619472:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.619474:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.619476:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.619929:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789131420.624347:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789131420.624517:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.624529:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624551:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.624557:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.624564:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624580:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624605:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624615:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624634:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131420.624647:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131420.624668:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624677:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131420.624682:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624695:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624719:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624729:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000622ddabf/0x9f0de371879056bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.624870:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.624879:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.624882:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131420.625446:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.625454:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625467:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.625471:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.625477:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625488:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625498:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625506:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625527:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131420.625537:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131420.625542:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625550:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131420.625554:0:14780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625575:0:14780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625588:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625595:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a0e7746/0x9f0de371879056c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.625610:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.625612:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.625614:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131420.626022:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.626029:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626039:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.626042:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.626047:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626059:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626067:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626084:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626100:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789131420.626110:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131420.626115:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626123:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131420.626127:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626135:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626148:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626156:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92c86dd/0x9f0de371879056cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.626169:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.626171:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.626172:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131420.630849:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.630874:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.630895:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.630901:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.630909:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.630927:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.630939:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.630949:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.631022:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789131420.631611:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.631619:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.631630:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.631634:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.631639:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.631807:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.631826:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.631835:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.631897:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131420.631908:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.631918:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.631924:0:14780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.631936:0:14780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.631966:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.631976:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000630ed063/0x9f0de371879056d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.632002:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.632006:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.632014:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.632017:0:14780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.632026:0:14780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.632037:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.632046:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.632048:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.632050:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.632148:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131420.632154:0:15475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a99897/0x9f0de371879056d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.632756:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.632764:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.632775:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.632780:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.632786:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.632799:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.632809:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.632829:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.632967:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131420.632976:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.632986:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131420.632990:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.633001:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.633021:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.633032:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131420.633034:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131420.633037:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.633167:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131420.633174:0:15475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ac2db55/0x9f0de371879056e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.633824:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.633832:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.633844:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.633849:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.633854:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.633867:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.633876:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.633885:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.634770:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.634782:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.634807:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.634812:0:14780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.634826:0:14780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.634843:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.635012:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.635016:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.635049:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131420.635056:0:15475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000460e519f/0x9f0de371879056e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.636039:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.636048:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.636064:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.636069:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.636076:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.636091:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.636102:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.636111:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.636220:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131420.636228:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.636236:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceaa00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131420.636239:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.636249:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.636277:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.636286:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131420.636288:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131420.636290:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.637988:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.639978:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131420.639996:0:15475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002201eb60/0x9f0de371879056ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789131420.640846:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.640855:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.640872:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.640876:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.640885:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.640900:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.640911:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.640918:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.641589:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131420.641600:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.641612:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceb000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131420.641618:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.641629:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.641775:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1789131420.642438:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.642449:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.642465:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.642471:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.642485:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.642500:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.642510:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.642519:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.642572:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.642584:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ccef135b/0x9f0de371879056f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.642653:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131420.642661:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.642670:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceae00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131420.642675:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.642684:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.642738:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.642811:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:3.0:1789131420.643290:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.643297:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.643308:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.643312:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.643316:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.643366:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.643374:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.643394:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643471:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643479:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9375f15/0x9f0de371879056fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643503:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131420.643507:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643514:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cea400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131420.643519:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643529:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643541:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.643550:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.643553:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.643556:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.647043:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.647152:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789131420.647167:0:15475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c9fc0ab6/0x9f0de37187905703 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.647736:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789131420.648234:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789131420.648243:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.648262:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=432s v=(0 0) 00010000:00010000:3.0:1789131420.648267:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789131420.648275:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.648292:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.648302:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.648311:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.649802:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131420.650642:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131420.650652:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.650673:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1789131420.650678:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131420.650685:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.650987:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.650999:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.651010:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41cebe00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.651016:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.651029:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.651054:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.651069:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044983b4a/0x9f0de3718790570a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.651101:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.651103:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.651105:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.653215:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.653242:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.653252:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.653839:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131420.654587:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131420.654598:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.654616:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1789131420.654621:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131420.654629:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.654643:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.654663:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.654671:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.655806:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789131420.655830:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131420.655839:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.655854:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131420.655860:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.655873:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131420.655878:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131420.655899:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.655910:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec2cac77/0x9f0de37187905711 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.655930:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.655939:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.655941:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131420.656652:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131420.656662:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.656677:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1789131420.656683:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131420.656690:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657532:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657546:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657556:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657578:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131420.657595:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131420.657601:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657610:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131420.657615:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657639:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657658:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657667:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071235cd3/0x9f0de3718790571f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.657689:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.657691:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131420.657693:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131420.658460:0:15475:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131420.658470:0:15475:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.658485:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=432s v=(0 0) 00010000:00010000:1.0:1789131420.658490:0:15475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131420.658497:0:15475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.658508:0:15475:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.658519:0:15475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.658538:0:15475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131420.658559:0:15475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789131420.659991:0:15475:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:0.0:1789131420.661845:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131420.661863:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.661882:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131420.661888:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.661903:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131420.661906:0:15475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14814:x1876039910393472:12345-0@lo:5:osp-pre-0-0.0 Request processed in 75530us (76164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131420.661928:0:15475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789131420.661937:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.661948:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea05e4d8/0x9f0de37187905726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131420.661977:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.661979:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131420.661981:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131420.663819:0:14814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14814:1876039910393472:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789131420.663844:0:14814:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789131420.663908:0:14814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14814:1876039910393600:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789131420.663984:0:14814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131420.664021:0:14814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4939b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131420.664102:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393600 00000100:00100000:1.0:1789131420.664111:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393600 00000100:00100000:1.0:1789131420.664177:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789131420.664188:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14814:x1876039910393600:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789131420.664246:0:15477:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1789131420.666020:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.666037:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.666056:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131420.666062:0:14780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.666076:0:14780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.666105:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.666119:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000629e9b1/0x9f0de37187905718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15475 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131420.666160:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.666163:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.666165:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.666170:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131420.666171:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131420.694992:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14814:x1876039910393600:12345-0@lo:5:osp-pre-0-0.0 Request processed in 30793us (30995us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789131420.695013:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131420.695414:0:14814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14814:1876039910393600:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789131420.695437:0:14814:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1789131421.017663:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131422.041683:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131423.069501:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789131423.826642:0:6729:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789131423.826673:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789131424.093131:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789131424.385610:0:16197:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789131424.385616:0:16197:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789131424.385815:0:16197:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c0c772ac800 00000020:01000004:3.0:1789131424.386023:0:16197:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789131424.386041:0:16197:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789131424.386063:0:16197:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c0c492c4ed8) 00000020:00000080:3.0:1789131424.386087:0:16197:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789131424.443167:0:16197:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789131424.446378:0:16197:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789131424.447222:0:16197:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789131424.447503:0:16197:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789131424.447723:0:16197:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789131424.448083:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 529: rc = 0 00100000:10000000:2.0:1789131424.448174:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1789131424.448267:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1789131424.448696:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 478: rc = 0 00100000:10000000:2.0:1789131424.453963:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 478: rc = 0 00100000:10000000:2.0:1789131424.455951:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 478: rc = 0 00100000:10000000:2.0:1789131424.456253:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 478: rc = 0 00100000:10000000:2.0:1789131424.456931:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 478: rc = 0 00100000:10000000:2.0:1789131424.457215:0:16197:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 478: rc = 0 00000020:00000080:2.0:1789131424.458794:0:16197:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789131424.458811:0:16197:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789131424.458827:0:16197:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9f0de37187905734 00000020:01000004:2.0:1789131424.458837:0:16197:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789131424.458865:0:16197:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789131424.458870:0:16197:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789131424.458881:0:16197:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789131424.458910:0:16197:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789131424.458915:0:16197:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1789131424.470888:0:16197:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789131424.470943:0:16197:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1789131424.470948:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789131424.470950:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789131424.470952:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131424.470953:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131424.470955:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131424.470956:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131424.470958:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131424.470960:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131424.470961:0:16197:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789131424.470967:0:16197:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1789131424.470969:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789131424.470970:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789131424.470972:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131424.470973:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131424.470974:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131424.470975:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131424.470976:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131424.470977:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131424.470978:0:16197:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789131424.471015:0:16197:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789131424.471043:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789131424.471151:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131424.471367:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55c5ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789131424.471534:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393728 00000100:00100000:2.0:1789131424.471544:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393728 00000100:00100000:2.0:1789131424.471760:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789131424.471772:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:16197:x1876039910393728:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789131424.471821:0:14785:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789131424.471824:0:14785:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789131424.471828:0:14785:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789131424.519988:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:16197:x1876039910393728:12345-0@lo:253:mount.lustre.0 Request processed in 48202us (48821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131424.520007:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789131424.520119:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789131424.520141:0:16197:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789131424.520145:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789131424.520147:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789131424.520148:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789131424.520150:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789131424.520151:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789131424.520153:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789131424.520155:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789131424.520157:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789131424.520159:0:16197:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789131424.520189:0:16197:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c0c772ac800 from lustre-OST0001 10000000:01000000:0.0:1789131424.520231:0:16197:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789131424.520234:0:16197:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789131424.520245:0:16197:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c0c772b4ed8 local copy 00010000:00010000:0.0:1789131424.520258:0:16197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131424.520959:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131424.521019:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131424.521139:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55c5ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.521193:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393856 00000100:00100000:1.0:1789131424.521202:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393856 00000100:00100000:1.0:1789131424.521296:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789131424.521308:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:16197:x1876039910393856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131424.521607:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:16197:x1876039910393856:12345-0@lo:501:mount.lustre.0 Request processed in 300us (587us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131424.521616:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789131424.521981:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393856:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789131424.522010:0:16197:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789131424.522210:0:16197:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789131424.522221:0:16197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131424.522234:0:16197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4600/0x9f0de371879054da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879054e1 expref: -99 pid: 14773 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131424.522269:0:16197:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c0c772ac800 10000000:01000000:2.0:1789131424.522275:0:16197:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789131424.522281:0:16197:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789131424.522284:0:16197:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789131424.522289:0:16197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789131424.522293:0:16197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789131424.522358:0:16197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131424.522368:0:16197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131424.522379:0:16197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131424.522409:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393984:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789131424.522470:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.522972:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c470279c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.523070:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910393984 00000100:00100000:0.0:1789131424.523080:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910393984 00000100:00100000:0.0:1789131424.523123:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789131424.523133:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:16197:x1876039910393984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131424.523150:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131424.523167:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14e00/0x9f0de37187905742 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790573b expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.523199:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14e00/0x9f0de37187905742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790573b expref: 17 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.523228:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14e00/0x9f0de37187905742 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790573b expref: 17 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.523239:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14e00, rc 0) 00000100:00100000:0.0:1789131424.523292:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910393984:12345-0@lo:101:mount.lustre.0 Request processed in 160us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.523300:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789131424.523404:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910393984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789131424.523426:0:16197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905742 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131424.523436:0:16197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905742 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131424.524508:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789131424.527210:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131424.528013:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789131424.528073:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789131424.528110:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789131424.528162:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789131424.528201:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789131424.528239:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789131424.528311:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789131424.528667:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789131424.528884:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131424.528976:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.529082:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47027000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.529136:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394112 00000100:00100000:0.0:1789131424.529145:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394112 00000100:00100000:0.0:1789131424.529252:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789131424.529263:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789131424.530223:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394112:12345-0@lo:501:mount.lustre.0 Request processed in 955us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.530236:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789131424.530380:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394112:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789131424.530443:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394240:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789131424.530494:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.530954:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47027000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.531038:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394240 00000100:00100000:1.0:1789131424.531045:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394240 00000100:00100000:1.0:1789131424.531097:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789131424.531105:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394240:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131424.531812:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394240:12345-0@lo:503:mount.lustre.0 Request processed in 705us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.531823:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789131424.533259:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394240:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131424.544087:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131424.544218:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394368:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131424.544384:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.551974:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47027000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.553599:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394368 00000100:00100000:1.0:1789131424.553617:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394368 00000100:00100000:1.0:1789131424.553845:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789131424.553859:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131424.554995:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394368:12345-0@lo:502:mount.lustre.0 Request processed in 1131us (10602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.555011:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789131424.555054:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a427840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394368:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789131424.555453:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789131424.555541:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789131424.555575:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789131424.555621:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789131424.555655:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789131424.555689:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789131424.555746:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789131424.555781:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789131424.555827:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789131424.555883:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789131424.555969:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.556024:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43091780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131424.558727:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394496 00000100:00100000:2.0:1789131424.558749:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394496 00000100:00100000:2.0:1789131424.558841:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789131424.558855:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131424.559557:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394496:12345-0@lo:502:mount.lustre.0 Request processed in 702us (3585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131424.559568:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789131424.560421:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789131424.560619:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789131424.560643:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789131424.565189:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789131424.565208:0:16198:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789131424.565217:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.565219:0:16198:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789131424.565227:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789131424.565246:0:16198:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c0c52a88000) 00000020:00000080:1.0:1789131424.565281:0:16198:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789131424.565288:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789131424.565423:0:16198:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c772ac800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789131424.565433:0:16198:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789131424.565441:0:16198:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9f0de37187905750 00010000:00010000:0.0:1789131424.596893:0:16198:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1789131424.597448:0:16198:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1789131424.613155:0:16198:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xc:0x0] (8/8/4) registered 00000020:00000080:2.0:1789131424.625913:0:16198:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789131424.625932:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131424.625941:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131424.625944:0:16198:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789131424.625950:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131424.625955:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131424.625957:0:16198:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789131424.625961:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789131424.625963:0:16198:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789131424.625966:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131424.625969:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131424.625970:0:16198:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789131424.625972:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789131424.625974:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131424.625976:0:16198:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789131424.625979:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789131424.626027:0:16198:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789131424.626030:0:16198:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789131424.626036:0:16198:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789131424.626040:0:16198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1789131424.626289:0:16197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1789131424.626356:0:16197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789131424.626380:0:16197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905742 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626395:0:16197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1c00/0x9f0de3718790573b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905742 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789131424.626412:0:16197:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c772ac800 from 1 10000000:01000000:1.0:1789131424.626415:0:16197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789131424.626463:0:16197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626472:0:16197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626486:0:16197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131424.626528:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789131424.626621:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.626671:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394624 00000100:00100000:1.0:1789131424.626679:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394624 00000100:00100000:1.0:1789131424.626741:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789131424.626751:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:16197:x1876039910394624:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131424.626767:0:14786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131424.626782:0:14786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905757 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626810:0:14786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905757 expref: 18 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626822:0:14786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905757 expref: 18 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626831:0:14786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c4e00, rc 0) 00000100:00100000:1.0:1789131424.626874:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910394624:12345-0@lo:101:mount.lustre.0 Request processed in 124us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.626882:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789131424.626933:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.626958:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789131424.626976:0:16197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.626986:0:16197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789131424.627588:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789131424.628023:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789131424.628359:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789131424.628406:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789131424.628468:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789131424.628476:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789131424.628551:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131424.628611:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.628675:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394752 00000100:00100000:1.0:1789131424.628682:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394752 00000100:00100000:1.0:1789131424.628736:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789131424.628747:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910394752:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131424.628950:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910394752:12345-0@lo:501:mount.lustre.0 Request processed in 204us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.628959:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789131424.628994:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.629015:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789131424.629053:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131424.629091:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.629113:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910394880 00000100:00100000:1.0:1789131424.629117:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910394880 00000100:00100000:1.0:1789131424.629140:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789131424.629146:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910394880:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789131424.629388:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910394880:12345-0@lo:503:mount.lustre.0 Request processed in 239us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.629396:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789131424.629427:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.629441:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910394880:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789131424.637494:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789131424.638823:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131424.639388:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.639512:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.646802:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395008 00000100:00100000:0.0:1789131424.646822:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395008 00000100:00100000:2.0:1789131424.647539:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789131424.647555:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c437c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910395008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131424.648028:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c437c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910395008:12345-0@lo:502:mount.lustre.0 Request processed in 473us (8638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131424.648038:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789131424.651563:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131424.652005:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789131424.652080:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789131424.652131:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789131424.652180:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789131424.652214:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789131424.652258:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789131424.652291:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789131424.652350:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:1.0:1789131424.652403:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:1.0:1789131424.652439:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:1.0:1789131424.652484:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10256 00000100:00100000:1.0:1789131424.652554:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789131424.652660:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.652727:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.653573:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395136 00000100:00100000:0.0:1789131424.653584:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395136 00000100:00100000:0.0:1789131424.653653:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789131424.653665:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910395136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131424.653984:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910395136:12345-0@lo:502:mount.lustre.0 Request processed in 319us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.653994:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789131424.654808:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d85a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789131424.654963:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10480 00000040:00080000:1.0:1789131424.654982:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789131424.656847:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131424.656863:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.656866:0:16202:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789131424.656875:0:16202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c772ac800 00000020:00000080:1.0:1789131424.656877:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131424.656887:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131424.656890:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.656891:0:16202:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789131424.656894:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131424.656896:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.656898:0:16202:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789131424.656901:0:16202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c0c772ac800 00000020:00000080:1.0:1789131424.656903:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131424.657295:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131424.657301:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.657303:0:16202:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789131424.657306:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131424.657309:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.657311:0:16202:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131424.657315:0:16202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c772ac800 00000020:00000080:1.0:1789131424.657317:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131424.657795:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131424.657800:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.657802:0:16202:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789131424.657805:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789131424.657821:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.657823:0:16202:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789131424.657827:0:16202:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c0c772ac800 00000020:00000080:1.0:1789131424.657829:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789131424.657889:0:16202:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789131424.657893:0:16202:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789131424.657894:0:16202:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789131424.657898:0:16202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1789131424.674856:0:16197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789131424.674917:0:16197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789131424.674957:0:16197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.674972:0:16197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131424.675082:0:16197:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789131424.675086:0:16197:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c0c772ac800 10000000:01000000:3.0:1789131424.675090:0:16197:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c0c772ac800 10000000:01000000:3.0:1789131424.675095:0:16197:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789131424.675103:0:16197:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c0c772ac800 from 1 10000000:01000000:3.0:1789131424.675107:0:16197:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789131424.675154:0:16197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.675163:0:16197:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.675176:0:16197:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131424.675541:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789131424.675689:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.675759:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.681751:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395264 00000100:00100000:0.0:1789131424.681774:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395264 00000100:00100000:0.0:1789131424.681859:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789131424.681870:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910395264:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789131424.681895:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131424.681922:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c74e14c00/0x9f0de3718790576c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905765 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.681958:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c74e14c00/0x9f0de3718790576c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905765 expref: 19 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.681972:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c74e14c00/0x9f0de3718790576c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905765 expref: 19 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131424.681983:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c74e14c00, rc 0) 00000100:00100000:0.0:1789131424.682090:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395264:12345-0@lo:101:mount.lustre.0 Request processed in 222us (6402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.682098:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789131424.686995:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789131424.687045:0:16197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790576c expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.687061:0:16197:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de3718790576c expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789131424.692210:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789131424.693022:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789131424.693373:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789131424.693431:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789131424.693465:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789131424.693512:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789131424.693548:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789131424.693600:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789131424.693637:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789131424.694843:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789131424.694959:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789131424.694996:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789131424.695028:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789131424.695100:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789131424.695138:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789131424.695191:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789131424.695241:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789131424.695277:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789131424.695309:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789131424.695381:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789131424.695417:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789131424.695451:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789131424.695498:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789131424.695532:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789131424.695565:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789131424.695616:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789131424.695653:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789131424.702015:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789131424.702146:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789131424.702185:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789131424.702222:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789131424.710825:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1789131424.710902:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1789131424.710939:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1789131424.710971:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789131424.711021:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789131424.711069:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789131424.711115:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789131424.711149:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789131424.711268:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789131424.711277:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789131424.711460:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131424.711557:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.711623:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395392 00000100:00100000:3.0:1789131424.711631:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395392 00000100:00100000:3.0:1789131424.714119:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131424.714150:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131424.714583:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395392:12345-0@lo:501:mount.lustre.0 Request processed in 448us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131424.714592:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789131424.714656:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2840 going to sleep for 11 seconds 00000100:00100000:3.0:1789131424.719089:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789131424.719175:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789131424.719488:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.719584:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.725081:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395520 00000100:00100000:0.0:1789131424.725102:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395520 00000100:00100000:0.0:1789131424.725180:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789131424.725192:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789131424.728362:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d73050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395520:12345-0@lo:503:mount.lustre.0 Request processed in 3158us (8861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.728381:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789131424.728678:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395520:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789131424.729472:0:16197:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789131424.729587:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395648:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789131424.729669:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.729724:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43151840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.732022:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395648 00000100:00100000:0.0:1789131424.732043:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395648 00000100:00100000:0.0:1789131424.732138:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789131424.732151:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395648:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131424.732665:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395648:12345-0@lo:502:mount.lustre.0 Request processed in 514us (2993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.732760:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789131424.732866:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4243c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395648:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789131424.733174:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789131424.733237:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789131424.733295:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789131424.733374:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789131424.733410:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789131424.733456:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789131424.733490:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789131424.733520:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789131424.733567:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789131424.733603:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789131424.733636:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789131424.733795:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789131424.733836:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789131424.733871:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789131424.733920:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789131424.733955:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789131424.733986:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789131424.734032:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789131424.734082:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789131424.734114:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789131424.734159:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789131424.734196:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789131424.734230:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789131424.734280:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789131424.734317:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789131424.734387:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789131424.734447:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789131424.734484:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789131424.734520:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789131424.734570:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789131424.734607:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789131424.734642:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789131424.734693:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789131424.734756:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789131424.734810:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789131424.734863:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789131424.734900:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789131424.734933:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789131424.734983:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789131424.735016:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789131424.735075:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395776:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131424.735166:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131424.735248:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395776 00000100:00100000:0.0:1789131424.735256:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395776 00000100:00100000:0.0:1789131424.735310:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789131424.735347:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395776:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789131424.735602:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910395776:12345-0@lo:502:mount.lustre.0 Request processed in 283us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.735611:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789131424.735669:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461b1240 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.735694:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910395776:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789131424.747298:0:16197:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789131424.747351:0:16197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789131424.748774:0:16208:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789131424.748796:0:16208:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c0c43720000) 00000020:00000080:0.0:1789131424.748833:0:16208:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1789131424.748951:0:16208:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c0c772ac800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789131424.748957:0:16208:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c0c772ac800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789131424.748960:0:16208:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c0c772ac800 3 00010000:00080000:0.0:1789131424.749004:0:16208:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c0c42ccd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1789131424.756954:0:16208:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789131424.757193:0:16208:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789131424.757250:0:16208:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789131424.757268:0:16208:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9f0de3718790577a 00000100:00080000:0.0:1789131424.757282:0:16208:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789131424.757289:0:16208:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c0c42ccd000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1789131424.759218:0:16208:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b42cf2580 x1876039910395904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789131424.759261:0:16208:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789131424.759372:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910395904:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789131424.759470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131424.759781:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910395904 00000100:00100000:0.0:1789131424.759792:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910395904 00000100:00100000:0.0:1789131424.759846:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789131424.759856:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1876039910395904:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789131424.759890:0:14791:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:0.0:1789131424.759945:0:14791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9f0de37187905781 00000004:00100000:0.0:1789131424.759969:0:14791:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789131424.760013:0:14791:0:(import.c:65:import_set_state_nolock()) ffff9c0c42cc8800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789131424.760078:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876039910395904:12345-0@lo:38:llog_process_th.0 Request processed in 221us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131424.760086:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789131424.760869:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0b42cf2580 x1876039910395904/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789131434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131424.760884:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131424.760897:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789131424.760907:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789131424.760912:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789131424.760916:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c42ccd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789131424.760923:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1876039910395904:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789131424.761090:0:15233:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789131424.761096:0:15233:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789131424.761099:0:15233:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789131424.761104:0:15233:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 432 00000100:00080000:2.0:1789131424.761109:0:15233:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789131424.761115:0:15233:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0c43e94800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1789131424.761137:0:15233:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0c7a424f00 x1876039910396160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789131424.761228:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910396288:0@lo:400:kworker.0 00000100:00100000:2.0:1789131424.761286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.761318:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789131424.761345:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910396416:0@lo:400:kworker.0 00000100:00100000:2.0:1789131424.761369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131424.761635:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a4270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910396032:0@lo:400:kworker.0 00000100:00100000:0.0:1789131424.761759:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.761883:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396288 00000100:00100000:1.0:1789131424.761891:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396288 00000100:00100000:1.0:1789131424.761945:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396416 00000100:00100000:1.0:1789131424.761949:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396416 00000100:00100000:1.0:1789131424.761988:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789131424.761999:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910396288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131424.762057:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910396288:12345-0@lo:400:kworker.0 Request processed in 60us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.762065:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789131424.762084:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131424.762098:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910396416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131424.762130:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1876039910396416:12345-0@lo:400:kworker.0 Request processed in 32us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.762136:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789131424.762158:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131424.762174:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910396160:0@lo:8:kworker.0 00000100:00100000:1.0:1789131424.762207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131424.762245:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396032 00000100:00100000:1.0:1789131424.762249:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396032 00000100:00100000:1.0:1789131424.762278:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396160 00000100:00100000:1.0:1789131424.762282:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396160 00000100:00100000:1.0:1789131424.762292:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131424.762299:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910396032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131424.762360:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910396032:12345-0@lo:400:kworker.0 Request processed in 61us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.762367:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131424.762379:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789131424.762383:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876039910396160:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789131424.762436:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876039910396160:12345-0@lo:8:kworker.0 Request processed in 51us (228us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789131424.762442:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789131424.762455:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131424.762489:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789131424.762509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4270c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910396032:0@lo:400:kworker.0 00000100:00100000:1.0:1789131424.762538:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789131424.762543:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789131424.762548:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789131424.762558:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910396160:0@lo:8:kworker.0 00000040:00080000:0.0:1789131424.767203:0:16208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:2.0:1789131424.767648:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a4252c0 x1876039910396416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131424.767682:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a4252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1876039910396416:0@lo:400:kworker.0 00010000:00080000:2.0:1789131424.767699:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c0c7a425e00 x1876039910396288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789131424.767708:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910396288:0@lo:400:kworker.0 00000020:01000000:2.0:1789131424.767765:0:16197:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789131424.767807:0:16197:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789131424.767828:0:16197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790576c expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131424.767841:0:16197:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea400/0x9f0de37187905765 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de3718790576c expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789131424.767932:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789131424.767935:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131424.767937:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131424.767938:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131424.767940:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131424.767941:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131424.767943:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131424.767946:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131424.767948:0:16197:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131424.767953:0:16197:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789131424.767956:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789131424.767957:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131424.767958:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131424.767960:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131424.767961:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131424.767962:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131424.767963:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131424.767964:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131424.767971:0:16197:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789131424.768003:0:16197:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789131424.768025:0:16197:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910396544:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789131424.768119:0:16197:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131424.768178:0:16197:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431519c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789131424.769848:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396544 00000100:00100000:0.0:1789131424.769864:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396544 00000100:00100000:0.0:1789131424.769937:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789131424.769949:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:16197:x1876039910396544:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789131424.769990:0:14786:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789131424.770008:0:14786:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789131424.808654:0:14786:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789131424.808685:0:14786:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789131424.808914:0:14807:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789131424.808920:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789131424.808952:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.808975:0:14807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905654 expref: 19 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.808984:0:14807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.809053:0:14807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 19 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.809069:0:14807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 19 pid: 14786 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131424.809089:0:14807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910396672:0@lo:104: 00000100:00100000:3.0:1789131424.809173:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.809228:0:14807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c461e2900 going to sleep for 11 seconds 00000100:00100000:1.0:1789131424.810090:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396672 00000100:00100000:1.0:1789131424.810105:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396672 00000100:00100000:1.0:1789131424.810172:0:14775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789131424.810184:0:14775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910396672:12345-0@lo:104: 00010000:00010000:1.0:1789131424.810205:0:14775:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131424.810284:0:14775:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789131424.810291:0:14775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:14807:x1876039910396672:12345-0@lo:104: Request processed in 110us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131424.810299:0:14775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131424.810475:0:14807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14807:1876039910396672:0@lo:104: 00010000:00010000:3.0:1789131424.810506:0:14807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810538:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789131424.810545:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810553:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131424.810557:0:14780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810566:0:14780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131424.810574:0:14780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131424.810580:0:14780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789131424.810635:0:14780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810643:0:14780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131424.810796:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810805:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c74e14800/0x9f0de37187905654 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790565b expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.810826:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131424.810828:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131424.810830:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131424.810854:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910396800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131424.810900:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131424.810958:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396800 00000100:00100000:3.0:1789131424.810964:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396800 00010000:00010000:3.0:1789131424.810988:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 20 pid: 14786 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131424.811012:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131424.811020:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+20:3308:x1876039910396800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131424.811033:0:14777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131424.811038:0:14777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 20 pid: 14786 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811049:0:14777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 20 pid: 14786 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811067:0:14777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742c5e00/0x9f0de3718790565b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187905654 expref: 20 pid: 14786 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811091:0:14777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811100:0:14777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789131424.811118:0:14777:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005877902s 00010000:00010000:3.0:1789131424.811123:0:14777:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811132:0:14777:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811139:0:14777:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811147:0:14777:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811153:0:14777:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b41ceaa00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:3.0:1789131424.811158:0:14777:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811166:0:14777:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811180:0:14777:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811190:0:14777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131424.811225:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3308:x1876039910396800:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131424.811233:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789131424.811258:0:14807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811267:0:14807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131424.811274:0:14807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b41ceaa00/0x9f0de37187905788 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131424.811303:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910396800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131424.822654:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:16197:x1876039910396544:12345-0@lo:253:mount.lustre.0 Request processed in 52689us (54516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131424.822819:0:16197:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a425e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:16197:1876039910396544:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789131424.822841:0:16197:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789131424.822845:0:16197:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789131424.822847:0:16197:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789131424.822849:0:16197:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789131424.822850:0:16197:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789131424.822852:0:16197:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789131424.822853:0:16197:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789131424.822855:0:16197:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789131424.822858:0:16197:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789131424.822859:0:16197:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789131424.822886:0:16197:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789131424.823645:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00080000:10000000:3.0:1789131424.829241:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131424.829487:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131424.829819:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131424.829979:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789131424.830224:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x8:0x0] (8/8/4) registered 00080000:10000000:3.0:1789131424.830555:0:16197:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789131424.831435:0:16197:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789131424.876501:0:16197:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789131424.876526:0:16197:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789131424.876575:0:16197:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789131424.876655:0:16197:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789131424.876686:0:16197:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789131424.876739:0:16197:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789131425.116403:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131425.756606:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789131425.756836:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910396928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131425.756974:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131425.757163:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910396928 00000100:00100000:1.0:1789131425.757173:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910396928 00000100:00100000:1.0:1789131425.757238:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131425.757252:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910396928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789131425.757303:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131425.757392:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910396928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131425.757400:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789131425.757612:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910396928:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789131426.140008:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789131426.585446:0:14788:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789131426.585457:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c0c43172000 from 8 10000000:01000000:3.0:1789131426.585464:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789131426.585529:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131426.585556:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131426.585593:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131426.585630:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910397056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131426.585735:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131426.585807:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c7615f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131426.586378:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397056 00000100:00100000:1.0:1789131426.586389:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397056 00000100:00100000:1.0:1789131426.586450:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789131426.586463:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910397056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131426.586483:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131426.586502:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742c5800/0x9f0de37187905796 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de3718790578f expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131426.586560:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742c5800/0x9f0de37187905796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de3718790578f expref: 19 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131426.586572:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742c5800/0x9f0de37187905796 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790578f expref: 19 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131426.586583:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742c5800, rc 0) 00000100:00100000:1.0:1789131426.586641:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910397056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131426.586649:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789131426.586884:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910397056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131426.586907:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905796 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131426.586918:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905796 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131426.586993:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910397184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789131426.587033:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131426.587069:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c7615f000 going to sleep for 11 seconds 00000100:00100000:1.0:1789131426.587251:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397184 00000100:00100000:1.0:1789131426.587258:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397184 00000100:00100000:1.0:1789131426.587287:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789131426.587295:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910397184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789131426.587311:0:14786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789131426.587355:0:14786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789131426.587359:0:14786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789131426.587470:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910397184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131426.587477:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789131426.589286:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910397184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789131426.589416:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789131426.589428:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905796 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131426.589441:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea000/0x9f0de3718790578f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905796 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131427.167261:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131427.555557:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131428.189416:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131429.210591:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789131429.858404:0:15233:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789131429.858412:0:15233:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789131429.858416:0:15233:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789131429.858430:0:15233:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c0c43e94800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1789131429.858456:0:15233:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c0b41d86580 x1876039910397568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789131429.858553:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910397440:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.858621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858699:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789131429.858705:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3307:1876039910397312:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.858733:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858754:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910397952:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.858777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858801:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910397568:0@lo:8:kworker.0 00000100:00100000:1.0:1789131429.858824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858849:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910397696:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.858871:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858887:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789131429.858892:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910397824:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.858910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.858938:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397440 00000100:00100000:1.0:1789131429.858945:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397440 00000100:00100000:1.0:1789131429.858989:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397568 00000100:00100000:1.0:1789131429.858992:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397568 00000100:00100000:1.0:1789131429.859004:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131429.859015:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910397440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.859064:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910397440:12345-0@lo:400:kworker.0 Request processed in 51us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859071:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131429.859088:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131429.859092:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1876039910397568:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789131429.859127:0:15478:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:1.0:1789131429.859155:0:15478:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9f0de3718790579d 00002000:00100000:1.0:1789131429.859170:0:15478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c0c47f7a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113984 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789131429.859175:0:15478:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789131429.859185:0:15478:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789131429.859526:0:15478:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789131429.859553:0:15478:0:(import.c:65:import_set_state_nolock()) ffff9c0c47f79000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131429.859597:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876039910397568:12345-0@lo:8:kworker.0 Request processed in 503us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859604:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789131429.859628:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397312 00000100:00100000:1.0:1789131429.859632:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397312 00000100:00100000:1.0:1789131429.859657:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789131429.859663:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3307:x1876039910397312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.859709:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3307:x1876039910397312:12345-0@lo:400:kworker.0 Request processed in 45us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859716:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789131429.859742:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397952 00000100:00100000:1.0:1789131429.859746:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397952 00000100:00100000:1.0:1789131429.859781:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397696 00000100:00100000:1.0:1789131429.859785:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397696 00000100:00100000:1.0:1789131429.859798:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910397824 00000100:00100000:1.0:1789131429.859800:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910397824 00000100:00100000:1.0:1789131429.859813:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131429.859819:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910397952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.859850:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1876039910397952:12345-0@lo:400:kworker.0 Request processed in 30us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859867:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789131429.859880:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131429.859886:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910397696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.859921:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1876039910397696:12345-0@lo:400:kworker.0 Request processed in 35us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859926:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131429.859937:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789131429.859943:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910397824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.859968:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910397824:12345-0@lo:400:kworker.0 Request processed in 25us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.859973:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789131429.860002:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789131429.860006:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789131429.860035:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b41d86580 x1876039910397568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789131454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789131429.860050:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789131429.860057:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789131429.860061:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789131429.860064:0:3305:0:(import.c:65:import_set_state_nolock()) ffff9c0c43e94800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789131429.860078:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789131429.860083:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1876039910397568:0@lo:8:kworker.0 00000004:00080000:1.0:1789131429.860126:0:14816:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789131429.860145:0:14816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14816:1876039910398208:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789131429.860171:0:14816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.860189:0:14816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c4367cb40 going to sleep for 11 seconds 00000004:00080000:1.0:1789131429.860210:0:14815:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789131429.860554:0:14815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441834230648ns, next at 0ns, rc = 0 00010000:00080000:1.0:1789131429.860870:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b41d86d00 x1876039910397824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131429.860881:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910397824:0@lo:400:kworker.0 00010000:00080000:1.0:1789131429.860893:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b41d84780 x1876039910397696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131429.860903:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1876039910397696:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.860929:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910398080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131429.860960:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.860986:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3307:1876039910397312:0@lo:400:kworker.0 00010000:00080000:1.0:1789131429.860999:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b41d84f00 x1876039910397952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789131445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131429.861009:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1876039910397952:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.861021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910397440:0@lo:400:kworker.0 00000100:00100000:1.0:1789131429.861051:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398080 00000100:00100000:1.0:1789131429.861057:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398080 00000100:00100000:1.0:1789131429.861098:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789131429.861105:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910398080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789131429.861132:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789131429.861176:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1876039910398080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.861183:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789131429.861212:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789131429.861228:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c0b41d86580 x1876039910398080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789131445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789131429.861241:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910398080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131429.861258:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398208 00000100:00100000:1.0:1789131429.861261:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398208 00000100:00100000:1.0:1789131429.861283:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131429.861289:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14816:x1876039910398208:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789131429.870271:0:15478:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789131429.870281:0:15478:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789131429.870287:0:15478:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:0.0:1789131429.892386:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.892398:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.892414:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.892418:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.892424:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.892449:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.892460:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.892467:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.892552:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789131429.893019:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.893026:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893035:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.893038:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.893042:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893051:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893058:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893077:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893094:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789131429.893108:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131429.893114:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893121:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.893126:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893134:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893153:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893161:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8e35fce/0x9f0de371879057a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893181:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.893185:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893203:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.893206:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893217:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893228:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893235:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097203d1d/0x9f0de371879057ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.893248:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.893250:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.893251:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131429.895201:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.899138:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.899151:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.899168:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.899172:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.899178:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.899192:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.899210:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.899217:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.899242:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789131429.908307:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131429.908337:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.908351:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131429.908355:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.908368:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.908402:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.908410:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000753877db/0x9f0de371879057b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.908430:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131429.908432:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131429.908434:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.917773:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.917785:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917800:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.917805:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.917811:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917825:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917834:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917843:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917872:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131429.917886:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.917892:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917900:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.917905:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917915:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917934:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917942:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd4fd887/0x9f0de371879057b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.917960:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.917962:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.917964:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.918418:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.918425:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918434:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.918443:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.918448:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918458:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918467:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918474:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918491:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789131429.918899:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.918906:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918914:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.918916:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.918921:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918930:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918937:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918951:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918967:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789131429.918979:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131429.918983:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.918990:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.918994:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919002:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919015:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919023:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d4fadd6/0x9f0de371879057c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919039:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.919042:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919058:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e15c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.919062:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919069:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919078:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919085:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a3180eb/0x9f0de371879057c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919096:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.919098:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.919100:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.919512:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.919518:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919527:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.919530:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.919535:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919545:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919558:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919565:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919578:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131429.919586:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.919590:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919596:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74e14800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.919599:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919607:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919617:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919624:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7d7c1e/0x9f0de371879057ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.919635:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.919640:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.919642:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.919992:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.919998:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920006:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.920010:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.920014:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920024:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920031:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920037:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920050:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131429.920059:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.920063:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920070:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.920074:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920092:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920104:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920111:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a0e7746/0x9f0de371879057d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920124:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.920126:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.920128:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131429.920565:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789131429.920572:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920580:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789131429.920583:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131429.920587:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920596:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920604:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920617:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920632:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789131429.920640:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.920644:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920651:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.920654:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920661:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.920673:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131429.923582:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.928561:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.928572:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.928589:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.928594:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.928601:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.928616:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.928626:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.928635:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.928662:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131429.929066:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.929072:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929080:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.929083:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.929087:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929097:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929105:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929112:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929126:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789131429.929540:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.929546:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929554:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.929563:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.929568:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929577:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929585:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929593:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929600:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1789131429.929946:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.929952:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929960:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.929963:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.929967:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929976:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929985:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.929998:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930005:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1789131429.930359:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.930364:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930372:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.930375:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.930379:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930388:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930396:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930403:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930411:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1789131429.930754:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.930759:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930771:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.930774:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.930779:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930788:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930796:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930804:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.930811:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:1.0:1789131429.931139:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.931144:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931152:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.931155:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.931159:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931167:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931185:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931193:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931200:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:1.0:1789131429.931555:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.931560:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931569:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.931572:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.931576:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931584:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931593:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931601:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.931617:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1789131429.932001:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de371879057dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932019:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789131429.932023:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932041:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932046:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932056:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932072:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932079:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007cc1a97c/0x9f0de371879057e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932092:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789131429.932096:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932102:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5e00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932105:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932111:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932119:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932130:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f9d4e30/0x9f0de371879057ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932140:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789131429.932144:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932149:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932152:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932160:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932168:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932174:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071235cd3/0x9f0de371879057f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932184:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789131429.932187:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932192:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932199:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932207:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932215:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932222:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000629e9b1/0x9f0de371879057f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932233:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789131429.932236:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932242:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932245:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932252:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932260:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932267:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea05e4d8/0x9f0de371879057ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932282:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789131429.932285:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932292:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932295:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932302:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932310:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932317:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000088d03fa/0x9f0de37187905806 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932341:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789131429.932344:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932350:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932353:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932369:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932379:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932387:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d824d68/0x9f0de3718790580d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932397:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789131429.932400:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932406:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131429.932408:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932416:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932424:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932432:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e2cb70d/0x9f0de37187905814 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131429.932451:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.932453:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.932455:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.932463:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131429.933144:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.936092:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.936105:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936122:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.936127:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.936134:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936148:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936159:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936166:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936186:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131429.936199:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.936204:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936212:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.936223:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936232:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936249:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936257:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f148e234/0x9f0de3718790581b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936275:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.936277:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.936279:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.936717:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.936724:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936732:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.936735:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.936739:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936748:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936757:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936771:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.936787:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131429.937180:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.937186:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937194:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.937197:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.937201:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937211:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937219:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937226:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937243:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789131429.937619:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.937624:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937640:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.937643:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.937647:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937655:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937663:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937670:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937698:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789131429.937710:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789131429.937716:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937724:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.937728:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937737:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937763:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937771:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daa16b1a/0x9f0de37187905822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937789:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131429.937792:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937798:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fd600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.937802:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937810:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937820:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937827:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f91d050/0x9f0de37187905829 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937837:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.937840:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937852:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fda00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.937855:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937862:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937871:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937878:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a72e1f6/0x9f0de37187905830 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.937889:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.937891:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.937893:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.938313:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.938341:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938352:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.938356:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.938360:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938370:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938385:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938393:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938411:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131429.938420:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.938424:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938432:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.938435:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938444:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938455:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938463:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd05a74/0x9f0de37187905837 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.938479:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.938486:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.938488:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.939083:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.939106:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789131429.948398:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:1.0:1789131429.957216:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.957230:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957244:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.957249:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.957255:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957268:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957280:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957287:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957307:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131429.957346:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.957351:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957360:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c413fc800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.957364:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957386:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957403:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957411:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b4d4b30/0x9f0de3718790583e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957430:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.957432:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.957433:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.957940:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.957946:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957954:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.957958:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.957962:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957972:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957979:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.957997:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958011:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789131429.958409:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.958415:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958423:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.958427:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.958431:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958439:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958447:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958454:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958467:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789131429.958855:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.958861:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958874:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.958877:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.958881:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958891:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958899:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958907:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958922:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789131429.958935:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789131429.958940:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958948:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb4800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.958952:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958961:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958988:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.958995:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d9b9dac/0x9f0de37187905845 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959012:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131429.959016:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959023:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb5200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.959026:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959033:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959041:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959049:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17c6e96/0x9f0de3718790584c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959063:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.959066:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959079:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb4000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.959082:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959090:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959100:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959108:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068bd4ec7/0x9f0de37187905853 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959118:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.959119:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.959121:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789131429.959515:0:15478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789131429.959521:0:15478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959529:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1789131429.959532:0:15478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131429.959536:0:15478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959545:0:15478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959559:0:15478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959566:0:15478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959579:0:15478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789131429.959587:0:16034:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131429.959591:0:16034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959596:0:16034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb4600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131429.959599:0:16034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959605:0:16034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959615:0:16034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959621:0:16034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c7eddf2/0x9f0de3718790585a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131429.959634:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.959641:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131429.959642:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.959840:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131429.959846:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789131429.964043:0:15478:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1789131429.964139:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14816:x1876039910398208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102845us (103962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131429.964150:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789131429.964206:0:14816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14816:1876039910398208:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789131429.964222:0:14816:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789131429.964268:0:14816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14816:1876039910398336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789131429.964300:0:14816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131429.964368:0:14816:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c431663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789131429.965608:0:15475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398336 00000100:00100000:3.0:1789131429.965626:0:15475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398336 00000100:00100000:3.0:1789131429.965694:0:15475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131429.965704:0:15475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:14816:x1876039910398336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789131429.965747:0:15475:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:1.0:1789131429.971063:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789131429.977190:0:15475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14816:x1876039910398336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11480us (12881us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789131429.977207:0:15475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789131429.977298:0:14816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14816:1876039910398336:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789131429.977313:0:14816:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789131430.239000:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131430.874480:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910398464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131430.874548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131430.874619:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398464 00000100:00100000:3.0:1789131430.874627:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398464 00000100:00100000:3.0:1789131430.874678:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131430.874687:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910398464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131430.874721:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131430.874768:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910398464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131430.874775:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789131430.874819:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910398464:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789131431.011841:0:16554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789131431.259463:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131432.289126:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131433.248718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.254906:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624448 00000100:00100000:3.0:1789131433.254933:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624448 00000100:00100000:3.0:1789131433.254991:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:3.0:1789131433.255001:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1876039893624448:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789131433.255032:0:14785:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:3.0:1789131433.255061:0:14785:0:(genops.c:1385:class_connect()) connect: client 2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5, cookie 0x9f0de37187905861 00000100:00080000:3.0:1789131433.255210:0:14785:0:(import.c:65:import_set_state_nolock()) ffff9c0c42e2e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131433.255274:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+5:2351:x1876039893624448:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 273us (6564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131433.255282:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1789131433.268057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.268197:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624576 00000100:00100000:1.0:1789131433.268206:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624576 00000100:00100000:1.0:1789131433.268261:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1789131433.268271:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+5:13944:x1876039893624576:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789131433.268288:0:14786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131433.268305:0:14786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb5800/0x9f0de37187905868 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0399b8 expref: -99 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.268365:0:14786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb5800/0x9f0de37187905868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399b8 expref: 6 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.268376:0:14786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb5800/0x9f0de37187905868 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399b8 expref: 6 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.268400:0:14786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb5800, rc 0) 00000100:00100000:1.0:1789131433.268466:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+6:13944:x1876039893624576:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 196us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.268472:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:0.0:1789131433.276268:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.277235:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624704 00000100:00100000:1.0:1789131433.277247:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624704 00000100:00100000:1.0:1789131433.277313:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1789131433.277360:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+6:13944:x1876039893624704:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789131433.277835:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+6:13944:x1876039893624704:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 511us (1575us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789131433.277844:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:2.0:1789131433.284752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.284850:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624832 00000100:00100000:3.0:1789131433.284881:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624832 00000100:00100000:3.0:1789131433.284935:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1789131433.284945:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+6:13944:x1876039893624832:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789131433.284961:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131433.284979:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceaa00/0x9f0de3718790586f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0399bf expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131433.285009:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceaa00/0x9f0de3718790586f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399bf expref: 7 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131433.285019:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceaa00/0x9f0de3718790586f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399bf expref: 7 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131433.285028:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceaa00, rc 0) 00000100:00100000:3.0:1789131433.285096:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+7:13944:x1876039893624832:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 152us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131433.285104:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:0.0:1789131433.300596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.300681:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893624960 00000100:00100000:1.0:1789131433.300692:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893624960 00000100:00100000:1.0:1789131433.300814:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1789131433.300833:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+7:13944:x1876039893624960:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789131433.301125:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13944:x1876039893624960:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 294us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.301135:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:0.0:1789131433.305745:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131433.313496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.315581:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625088 00000100:00100000:2.0:1789131433.315594:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625088 00000100:00100000:2.0:1789131433.315790:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1789131433.315800:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13944:x1876039893625088:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789131433.316231:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13944:x1876039893625088:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 430us (2743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.316241:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1789131433.323413:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.323620:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625216 00000100:00100000:1.0:1789131433.323630:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625216 00000100:00100000:1.0:1789131433.323699:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1789131433.323710:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13963:x1876039893625216:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131433.326185:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13963:x1876039893625216:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 2467us (2772us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.326214:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1789131433.353138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.353468:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625344 00000100:00100000:2.0:1789131433.353496:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625344 00000100:00100000:2.0:1789131433.353554:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:2.0:1789131433.353565:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13963:x1876039893625344:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131433.355161:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13963:x1876039893625344:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 1591us (2214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.355174:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1789131433.372729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.372922:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625472 00000100:00100000:3.0:1789131433.372932:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625472 00000100:00100000:1.0:1789131433.373705:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1789131433.373720:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+8:13944:x1876039893625472:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789131433.373737:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131433.373754:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb4a00/0x9f0de37187905876 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0399e9 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.373791:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb4a00/0x9f0de37187905876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399e9 expref: 9 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.373801:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb4a00/0x9f0de37187905876 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399e9 expref: 9 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131433.373810:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb4a00, rc 0) 00000100:00100000:1.0:1789131433.373871:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a668c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+9:13944:x1876039893625472:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 156us (1152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.373878:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1789131433.391511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.391661:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625600 00000100:00100000:2.0:1789131433.391672:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625600 00000100:00100000:2.0:1789131433.391857:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1789131433.391874:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+9:13944:x1876039893625600:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789131433.391901:0:14786:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789131433.391925:0:14786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789131433.391929:0:14786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789131433.391932:0:14786:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789131433.391934:0:14786:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789131433.394079:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+9:13944:x1876039893625600:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 2197us (2567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.394092:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:0.0:1789131433.403482:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.403581:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625728 00000100:00100000:2.0:1789131433.403590:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625728 00000100:00100000:2.0:1789131433.403648:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1789131433.403666:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+9:13944:x1876039893625728:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789131433.403691:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131433.403710:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb0399f0 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.403737:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.403774:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 10 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.403784:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1a00, rc 0) 00000100:00100000:2.0:1789131433.403841:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a66b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13944:x1876039893625728:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 176us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.403848:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:1.0:1789131433.407734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.407891:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625856 00000100:00100000:2.0:1789131433.407902:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625856 00000100:00100000:2.0:1789131433.407960:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:2.0:1789131433.407970:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13944:x1876039893625856:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789131433.408257:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13944:x1876039893625856:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 287us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.408266:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1789131433.417791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.419594:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893625984 00000100:00100000:1.0:1789131433.419607:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893625984 00000100:00100000:1.0:1789131433.419695:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:1.0:1789131433.419706:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13944:x1876039893625984:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789131433.420029:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13944:x1876039893625984:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 324us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.420038:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1789131433.427558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.428017:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626112 00000100:00100000:1.0:1789131433.428028:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626112 00000100:00100000:1.0:1789131433.428084:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:1.0:1789131433.428094:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13968:x1876039893626112:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789131433.428602:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13968:x1876039893626112:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 508us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.428612:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:1.0:1789131433.435539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.435639:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626240 00000100:00100000:3.0:1789131433.435659:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626240 00000100:00100000:3.0:1789131433.435714:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1789131433.435724:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13968:x1876039893626240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131433.435975:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:13968:x1876039893626240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 252us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131433.435984:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:0.0:1789131433.450827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.451024:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626368 00000100:00100000:1.0:1789131433.451034:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626368 00000100:00100000:1.0:1789131433.451084:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1789131433.451092:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1876039893626368:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789131433.451120:0:15748:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 8f0519b8-1f34-4031-b607-119670debea2@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:1.0:1789131433.451164:0:15748:0:(genops.c:1385:class_connect()) connect: client 8f0519b8-1f34-4031-b607-119670debea2, cookie 0x9f0de37187905884 00000004:00100000:1.0:1789131433.451195:0:15748:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789131433.451201:0:15748:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1789131433.556967:0:15748:0:(import.c:65:import_set_state_nolock()) ffff9c0c7aa30000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789131433.557043:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+6:2351:x1876039893626368:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 105950us (106225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.557053:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1789131433.562689:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131433.562812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.562902:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626496 00000100:00100000:2.0:1789131433.562912:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626496 00000100:00100000:1.0:1789131433.562919:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626624 00000100:00100000:1.0:1789131433.562922:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626624 00000100:00100000:1.0:1789131433.562976:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:3.0:1789131433.562980:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789131433.562985:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:13944:x1876039893626624:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131433.563029:0:14793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789131433.563116:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:13944:x1876039893626624:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.563124:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1789131433.563142:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1789131433.563149:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+6:0:x1876039893626496:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131433.563175:0:14793:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789131433.563198:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+6:0:x1876039893626496:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 50us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.563205:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1789131433.566658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.566724:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626752 00000100:00100000:3.0:1789131433.566753:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626752 00000100:00100000:3.0:1789131433.566804:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1789131433.566814:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+6:13944:x1876039893626752:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789131433.566905:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+6:13944:x1876039893626752:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 92us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131433.566913:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1789131433.570595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.570635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131433.570702:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893626880 00000100:00100000:1.0:1789131433.570712:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893626880 00000100:00100000:1.0:1789131433.570755:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627008 00000100:00100000:1.0:1789131433.570758:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627008 00000100:00100000:1.0:1789131433.570773:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1789131433.570781:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876039893626880:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789131433.570826:0:15477:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 8f0519b8-1f34-4031-b607-119670debea2@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:1.0:1789131433.570859:0:15477:0:(genops.c:1385:class_connect()) connect: client 8f0519b8-1f34-4031-b607-119670debea2, cookie 0x9f0de3718790588b 00002000:00100000:1.0:1789131433.570871:0:15477:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8f0519b8-1f34-4031-b607-119670debea2/ffff9c0c47f7f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789131433.570896:0:15477:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789131433.571214:0:15477:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789131433.571245:0:15477:0:(import.c:65:import_set_state_nolock()) ffff9c0c47f7e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131433.571312:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+6:2351:x1876039893626880:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 529us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.571345:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1789131433.571364:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1789131433.571369:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876039893627008:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789131433.571385:0:15477:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 8f0519b8-1f34-4031-b607-119670debea2@192.168.203.52@tcp t0 exp 0000000000000000 cur 445 last 0 00000020:00000080:1.0:1789131433.571401:0:15477:0:(genops.c:1385:class_connect()) connect: client 8f0519b8-1f34-4031-b607-119670debea2, cookie 0x9f0de37187905892 00002000:00100000:1.0:1789131433.571407:0:15477:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8f0519b8-1f34-4031-b607-119670debea2/ffff9c0c47f7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789131433.571445:0:15477:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789131433.572032:0:15477:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789131433.572053:0:15477:0:(import.c:65:import_set_state_nolock()) ffff9c0c47f79800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789131433.572102:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+6:2351:x1876039893627008:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 730us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131433.572110:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1789131433.572228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131433.572357:0:14794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627136 00000100:00100000:3.0:1789131433.572363:0:14794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627136 00000100:00100000:3.0:1789131433.572392:0:14794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1789131433.572400:0:14794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+6:13944:x1876039893627136:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:3.0:1789131433.574158:0:14794:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1705us 00000004:00200000:0.0:1789131433.601342:0:14794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789131433.601623:0:14794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+6:13944:x1876039893627136:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 29218us (29389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131433.601643:0:14794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1789131433.833162:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131433.833366:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627264 00000100:00100000:2.0:1789131433.833376:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627264 00000100:00100000:2.0:1789131433.833486:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1789131433.833497:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+6:13991:x1876039893627264:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1789131433.833531:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131433.833557:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905899 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a1a expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.833620:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.833634:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.833657:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131433.833848:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131433.833853:0:14793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131433.833951:0:14793:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.833978:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905899 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a1a expref: 8 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.833995:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a1a expref: 7 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131433.834003:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131433.834006:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131433.834010:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1400, rc 0) 00000100:00100000:2.0:1789131433.834075:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:13991:x1876039893627264:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 580us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131433.834082:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000001:00100000:3.0:1789131434.025810:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8f0519b8-1f34-4031-b607-119670debea2 00010000:00010000:0.0:1789131434.335469:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131434.969625:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789131434.969658:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910398592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131434.969731:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131434.974259:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398592 00000100:00100000:3.0:1789131434.974269:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398592 00000100:00100000:3.0:1789131434.974352:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131434.974362:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910398592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789131434.974386:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131434.974471:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1876039910398592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.974479:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131434.974539:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910398720:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974579:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131434.974613:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910399232:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131434.974694:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789131434.974701:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910398848:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974724:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789131434.974761:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789131434.974776:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399232 00000100:00100000:3.0:1789131434.974779:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399232 00000100:00100000:3.0:1789131434.974814:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131434.974820:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910399232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974859:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1876039910399232:12345-0@lo:400:kworker.0 Request processed in 39us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.974866:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789131434.974880:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131434.974888:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910399104:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974913:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131434.974930:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789131434.974937:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910398976:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.974960:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131434.974984:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399104 00000100:00100000:3.0:1789131434.974987:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399104 00000100:00100000:3.0:1789131434.975013:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398976 00000100:00100000:3.0:1789131434.975016:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398976 00000100:00100000:3.0:1789131434.975030:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789131434.975036:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910399104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975070:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910399104:12345-0@lo:400:kworker.0 Request processed in 34us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.975077:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789131434.975100:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789131434.975106:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910398976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975135:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1876039910398976:12345-0@lo:400:kworker.0 Request processed in 29us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.975141:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789131434.975155:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131434.975182:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1876039910398976:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975192:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910399104:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975255:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d8a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910398592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131434.975284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1876039910399232:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975348:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398720 00000100:00100000:3.0:1789131434.975352:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398720 00000100:00100000:3.0:1789131434.975378:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789131434.975385:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3306:x1876039910398720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975420:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3306:x1876039910398720:12345-0@lo:400:kworker.0 Request processed in 36us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.975426:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789131434.975459:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3306:1876039910398720:0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975483:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910398848 00000100:00100000:3.0:1789131434.975486:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910398848 00000100:00100000:3.0:1789131434.975516:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789131434.975523:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910398848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789131434.975557:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910398848:12345-0@lo:400:kworker.0 Request processed in 35us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131434.975573:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789131434.975590:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789131434.975606:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910398848:0@lo:400:kworker.0 00000001:00100000:1.0:1789131435.112010:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8f0519b8-1f34-4031-b607-119670debea2 00000001:00080000:1.0:1789131435.112052:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1789131435.355056:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131435.694873:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.699363:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627392 00000100:00100000:3.0:1789131435.699376:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627392 00000100:00100000:3.0:1789131435.699465:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1789131435.699475:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a425e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+7:14043:x1876039893627392:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:3.0:1789131435.699519:0:14791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1789131435.700562:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131435.704496:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a425e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+7:14043:x1876039893627392:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 5012us (9623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.704509:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1789131435.713882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.713971:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627520 00000100:00100000:3.0:1789131435.713981:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627520 00000100:00100000:3.0:1789131435.714107:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1789131435.714117:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f0519b8-1f34-4031-b607-119670debea2+5:14043:x1876039893627520:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1789131435.714152:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131435.714245:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f0519b8-1f34-4031-b607-119670debea2+5:14043:x1876039893627520:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 130us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.714254:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:0.0:1789131435.716146:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789131435.719851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.719934:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627648 00000100:00100000:3.0:1789131435.719944:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627648 00000100:00100000:3.0:1789131435.720006:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1789131435.720016:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f0519b8-1f34-4031-b607-119670debea2+5:14043:x1876039893627648:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1789131435.720054:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131435.720133:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8f0519b8-1f34-4031-b607-119670debea2+5:14043:x1876039893627648:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 118us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.720153:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:0.0:1789131435.720601:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131435.950787:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131435.950883:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627776 00000100:00100000:1.0:1789131435.950892:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627776 00000100:00100000:1.0:1789131435.950950:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1789131435.950960:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+10:14073:x1876039893627776:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789131435.950975:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131435.950992:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb5000/0x9f0de371879058a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a21 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131435.951019:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb5000/0x9f0de371879058a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a21 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131435.951031:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb5000/0x9f0de371879058a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a21 expref: 11 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131435.951039:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb5000, rc 0) 00000100:00100000:1.0:1789131435.951150:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893627776:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 191us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131435.951158:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1789131435.964833:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.964919:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893627904 00000100:00100000:3.0:1789131435.964929:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893627904 00000100:00100000:3.0:1789131435.965042:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:3.0:1789131435.965053:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893627904:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789131435.965387:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893627904:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 335us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.965396:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:2.0:1789131435.976944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.977150:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628032 00000100:00100000:3.0:1789131435.977161:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628032 00000100:00100000:3.0:1789131435.977217:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:3.0:1789131435.977227:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893628032:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789131435.978138:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893628032:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 907us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131435.978149:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:1.0:1789131435.994269:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789131435.994293:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910399360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789131435.994375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131435.995882:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399360 00000100:00100000:3.0:1789131435.995892:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399360 00000100:00100000:3.0:1789131435.995946:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789131435.995954:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910399360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131435.995976:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131435.996039:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910399360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (1664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.996046:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789131435.996364:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910399360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131435.996513:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131435.996618:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628160 00000100:00100000:3.0:1789131435.996622:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628160 00000100:00100000:3.0:1789131435.996664:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1789131435.996671:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14082:x1876039893628160:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131435.996965:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14082:x1876039893628160:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 293us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131435.996979:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:1.0:1789131436.021050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.021202:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628288 00000100:00100000:2.0:1789131436.021211:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628288 00000100:00100000:2.0:1789131436.021265:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1789131436.021276:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14082:x1876039893628288:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131436.021815:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14082:x1876039893628288:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 539us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.021834:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1789131436.033785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.034100:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628416 00000100:00100000:2.0:1789131436.034109:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628416 00000100:00100000:2.0:1789131436.034169:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:2.0:1789131436.034179:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:14073:x1876039893628416:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789131436.034198:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131436.034215:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b0000/0x9f0de371879058ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a4b expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.034241:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b0000/0x9f0de371879058ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a4b expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.034265:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b0000/0x9f0de371879058ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a4b expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.034274:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0000, rc 0) 00000100:00100000:2.0:1789131436.034622:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:14073:x1876039893628416:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 442us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.034629:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1789131436.041313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131436.041494:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628544 00000100:00100000:3.0:1789131436.041916:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628544 00000100:00100000:3.0:1789131436.041993:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1789131436.042005:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7babf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:14073:x1876039893628544:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789131436.042039:0:14784:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789131436.042071:0:14784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789131436.042076:0:14784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789131436.042080:0:14784:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789131436.042082:0:14784:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789131436.054131:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7babf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:14073:x1876039893628544:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 12110us (12816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.054149:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:2.0:1789131436.058178:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.058360:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628672 00000100:00100000:1.0:1789131436.058373:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628672 00000100:00100000:1.0:1789131436.058450:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1789131436.058463:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:14073:x1876039893628672:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789131436.058486:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131436.058510:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a52 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131436.058548:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 13 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131436.058562:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 13 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131436.058573:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb4200, rc 0) 00000100:00100000:1.0:1789131436.058658:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14073:x1876039893628672:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 197us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.058665:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1789131436.062913:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.063126:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628800 00000100:00100000:2.0:1789131436.063138:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628800 00000100:00100000:2.0:1789131436.063212:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1789131436.063225:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14073:x1876039893628800:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789131436.064070:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14073:x1876039893628800:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 842us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.064082:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1789131436.077395:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.081287:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893628928 00000100:00100000:1.0:1789131436.081308:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893628928 00000100:00100000:1.0:1789131436.082364:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1789131436.082397:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14073:x1876039893628928:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789131436.083650:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14073:x1876039893628928:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 1239us (6252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.083665:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:0.0:1789131436.091007:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.091712:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629056 00000100:00100000:2.0:1789131436.091726:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629056 00000100:00100000:2.0:1789131436.091804:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1789131436.091816:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14085:x1876039893629056:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789131436.092161:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14085:x1876039893629056:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 346us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.092180:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1789131436.095088:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131436.095249:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629184 00000100:00100000:3.0:1789131436.095261:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629184 00000100:00100000:3.0:1789131436.095356:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1789131436.095369:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14085:x1876039893629184:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789131436.095713:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:14085:x1876039893629184:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 345us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131436.095722:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:3.0:1789131436.101210:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131436.101260:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.101382:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629824 00000100:00100000:1.0:1789131436.101395:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629824 00000100:00100000:1.0:1789131436.101483:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1789131436.101496:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+5:2355:x1876039893629824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1789131436.101587:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+5:2355:x1876039893629824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.101594:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1789131436.104687:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.105051:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629952 00000100:00100000:2.0:1789131436.105062:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629952 00000100:00100000:2.0:1789131436.105142:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131436.105154:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2355:x1876039893629952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131436.105241:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2355:x1876039893629952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 89us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.105250:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131436.106163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131436.109620:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629696 00000100:00100000:0.0:1789131436.109649:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629696 00000100:00100000:0.0:1789131436.109775:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629312 00000100:00100000:0.0:1789131436.109779:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629312 00000100:00100000:3.0:1789131436.112698:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131436.112728:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:2355:x1876039893629696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131436.112852:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:2355:x1876039893629696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 140us (11591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131436.112860:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131436.112905:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131436.112910:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1876039893629312:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789131436.112939:0:14793:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 625380bf-5b63-443b-85ed-920fb77537b0@192.168.203.52@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1789131436.112981:0:14793:0:(genops.c:1385:class_connect()) connect: client 625380bf-5b63-443b-85ed-920fb77537b0, cookie 0x9f0de371879058bc 00000004:00100000:3.0:1789131436.113020:0:14793:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789131436.116001:0:14793:0:(import.c:65:import_set_state_nolock()) ffff9c0c7656c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131436.116416:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:625380bf-5b63-443b-85ed-920fb77537b0+6:2351:x1876039893629312:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 3501us (10255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131436.116431:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1789131436.124557:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.124683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.131866:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629568 00000100:00100000:1.0:1789131436.131889:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629568 00000100:00100000:1.0:1789131436.131984:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893629440 00000100:00100000:1.0:1789131436.131988:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893629440 00000100:00100000:1.0:1789131436.132024:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131436.132035:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+7:14073:x1876039893629568:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131436.132108:0:15748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789131436.132205:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+7:14073:x1876039893629568:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 172us (7769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.132215:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131436.132236:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1789131436.132244:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+6:0:x1876039893629440:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789131436.132256:0:15748:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789131436.132282:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+6:0:x1876039893629440:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 39us (7600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.132307:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:0.0:1789131436.133573:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131436.135987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.136089:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630080 00000100:00100000:1.0:1789131436.136109:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630080 00000100:00100000:1.0:1789131436.136177:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1789131436.136188:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a427840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+6:14073:x1876039893630080:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789131436.136295:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a427840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+6:14073:x1876039893630080:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 107us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131436.136303:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1789131436.141147:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.141248:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131436.141286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131436.141452:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630208 00000100:00100000:3.0:1789131436.141473:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630208 00000100:00100000:3.0:1789131436.141520:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630336 00000100:00100000:3.0:1789131436.141523:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630336 00000100:00100000:3.0:1789131436.141539:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131436.141548:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876039893630208:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789131436.141588:0:15477:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 625380bf-5b63-443b-85ed-920fb77537b0@192.168.203.52@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1789131436.141641:0:15477:0:(genops.c:1385:class_connect()) connect: client 625380bf-5b63-443b-85ed-920fb77537b0, cookie 0x9f0de371879058c3 00002000:00100000:3.0:1789131436.141657:0:15477:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 625380bf-5b63-443b-85ed-920fb77537b0/ffff9c0c7656e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789131436.141671:0:15477:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789131436.141979:0:15477:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789131436.142020:0:15477:0:(import.c:65:import_set_state_nolock()) ffff9c0c7656b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131436.142112:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:2351:x1876039893630208:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 551us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131436.142121:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1789131436.142145:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1789131436.142168:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876039893630336:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789131436.142186:0:15477:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 625380bf-5b63-443b-85ed-920fb77537b0@192.168.203.52@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:3.0:1789131436.142205:0:15477:0:(genops.c:1385:class_connect()) connect: client 625380bf-5b63-443b-85ed-920fb77537b0, cookie 0x9f0de371879058ca 00002000:00100000:3.0:1789131436.142210:0:15477:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 625380bf-5b63-443b-85ed-920fb77537b0/ffff9c0c7656d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113984 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789131436.142216:0:15477:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789131436.142398:0:15477:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789131436.142415:0:15477:0:(import.c:65:import_set_state_nolock()) ffff9c0c7656f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789131436.142439:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:2351:x1876039893630336:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 271us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131436.142447:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1789131436.145859:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630464 00000100:00100000:0.0:1789131436.145878:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630464 00000100:00100000:0.0:1789131436.145963:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1789131436.145975:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:14073:x1876039893630464:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789131436.147693:0:14795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1789131436.148441:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:14073:x1876039893630464:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 2458us (7299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131436.148582:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1789131436.341628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131436.341954:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630592 00000100:00100000:2.0:1789131436.341967:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630592 00000100:00100000:2.0:1789131436.342039:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1789131436.342051:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:14107:x1876039893630592:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:2.0:1789131436.342080:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131436.342121:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de371879058d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a7c expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342208:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342226:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342264:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131436.342559:0:14792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131436.342564:0:14792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131436.342667:0:14792:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342703:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0800/0x9f0de371879058d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 8 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342723:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 7 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131436.342733:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131436.342736:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131436.342740:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0a00, rc 0) 00000100:00100000:2.0:1789131436.342831:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+7:14107:x1876039893630592:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 782us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131436.342840:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:0.0:1789131436.379945:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131437.404375:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789131437.787824:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789131438.425676:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789131438.609728:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8f0519b8-1f34-4031-b607-119670debea2 00000001:00100000:3.0:1789131438.609753:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 625380bf-5b63-443b-85ed-920fb77537b0 00000001:00100000:3.0:1789131439.174762:0:6729:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 625380bf-5b63-443b-85ed-920fb77537b0 00000001:02000400:2.0:1789131439.446886:0:16763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789131439.449567:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131440.090724:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910399488:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.090822:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131440.090895:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910400000:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.090926:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131440.090959:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789131440.090965:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910399616:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.090992:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131440.091012:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910400128:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.091041:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131440.091077:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910399744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091085:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399488 00000100:00100000:2.0:1789131440.091095:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399488 00000100:00100000:0.0:1789131440.091105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131440.091129:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131440.091135:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910399872:0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091156:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789131440.091162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131440.091173:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3308:x1876039910399488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.091199:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400000 00000100:00100000:0.0:1789131440.091204:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400000 00000100:00100000:2.0:1789131440.091248:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3308:x1876039910399488:12345-0@lo:400:kworker.0 Request processed in 79us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131440.091251:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400128 00000100:00100000:0.0:1789131440.091256:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400128 00000100:00100000:2.0:1789131440.091262:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789131440.091275:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399872 00000100:00100000:0.0:1789131440.091279:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399872 00000100:00100000:0.0:1789131440.091296:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789131440.091306:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910400000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091346:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399616 00000100:00100000:2.0:1789131440.091351:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399616 00000100:00100000:0.0:1789131440.091370:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1876039910400000:12345-0@lo:400:kworker.0 Request processed in 66us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131440.091378:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789131440.091387:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910399744 00000100:00100000:2.0:1789131440.091391:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910399744 00000100:00100000:0.0:1789131440.091399:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131440.091415:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131440.091423:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910399616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091457:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1876039910399616:12345-0@lo:400:kworker.0 Request processed in 35us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131440.091463:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131440.091475:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131440.091481:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910399744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091512:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910399744:12345-0@lo:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131440.091518:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131440.091540:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789131440.091548:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910399872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091578:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1876039910399872:12345-0@lo:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131440.091584:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789131440.091622:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910400128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091647:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742da1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1876039910399616:0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.091662:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910399488:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.091673:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1876039910400128:12345-0@lo:400:kworker.0 Request processed in 266us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131440.091683:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789131440.091691:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742dad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1876039910400000:0@lo:400:kworker.0 00000100:00080000:0.0:1789131440.091713:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131440.091718:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131440.091721:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131440.091728:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742da940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1876039910400128:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.092133:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742db840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1876039910399872:0@lo:400:kworker.0 00000100:00100000:0.0:1789131440.092144:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789131440.092193:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742d8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910399744:0@lo:400:kworker.0 00000100:00100000:2.0:1789131440.101711:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910400256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789131440.101817:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131440.102071:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400256 00000100:00100000:2.0:1789131440.102080:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400256 00000100:00100000:0.0:1789131440.103984:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789131440.104003:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910400256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789131440.104050:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789131440.104148:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910400256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131440.104157:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789131440.106188:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910400256:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789131440.168986:0:7662:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 625380bf-5b63-443b-85ed-920fb77537b0 00010000:00010000:1.0:1789131440.475532:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131441.113629:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910400384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131441.113728:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131441.113870:0:15480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400384 00000100:00100000:3.0:1789131441.113882:0:15480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400384 00000100:00100000:3.0:1789131441.113946:0:15480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789131441.113956:0:15480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910400384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131441.114002:0:15480:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131441.114066:0:15480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910400384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131441.114075:0:15480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789131441.114401:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910400384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131441.414377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414431:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.414576:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630848 00000100:00100000:0.0:1789131441.414614:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630848 00000100:00100000:0.0:1789131441.414682:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631232 00000100:00100000:0.0:1789131441.414686:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631232 00000100:00100000:0.0:1789131441.414710:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1789131441.414721:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+6:2354:x1876039893630848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.414813:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+6:2354:x1876039893630848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.414823:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1789131441.414846:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1789131441.414853:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:2354:x1876039893631232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.414876:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:2354:x1876039893631232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.414883:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1789131441.414909:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631104 00000100:00100000:0.0:1789131441.414913:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631104 00000100:00100000:0.0:1789131441.414947:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631360 00000100:00100000:0.0:1789131441.414950:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631360 00000100:00100000:0.0:1789131441.414961:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630976 00000100:00100000:0.0:1789131441.414963:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630976 00000100:00100000:0.0:1789131441.414977:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131441.414984:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2354:x1876039893631104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.415008:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2354:x1876039893631104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.415016:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131441.415026:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1789131441.415032:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2354:x1876039893631360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.415065:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2354:x1876039893631360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.415072:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1789131441.415083:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1789131441.415089:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2354:x1876039893630976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.415110:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2354:x1876039893630976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 21us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.415117:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1789131441.415139:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893630720 00000100:00100000:0.0:1789131441.415142:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893630720 00000100:00100000:0.0:1789131441.415167:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:0.0:1789131441.415173:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2354:x1876039893630720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.415198:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2354:x1876039893630720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.415205:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00080000:0.0:1789131441.415242:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789131441.415248:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789131441.415251:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789131441.416263:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131441.417696:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631488 00000100:00100000:0.0:1789131441.417712:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631488 00000100:00100000:0.0:1789131441.417801:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1789131441.417812:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2354:x1876039893631488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1789131441.417898:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2354:x1876039893631488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 87us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131441.417906:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:2.0:1789131441.418414:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789131441.498056:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789131442.522664:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789131442.743553:0:16911:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe824eba80 20000000:00000080:3.0:1789131442.743576:0:16911:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c0b43620000 uarg=0000000000000000 20000000:01000000:3.0:1789131442.749523:0:16911:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789131442.749531:0:16911:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789131442.749537:0:16911:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789131442.755722:0:16912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1789131442.757815:0:16911:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789131442.771009:0:16911:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789131442.771196:0:16911:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771221:0:16911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879055cf expref: 18 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771230:0:16911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de3718790561c expref: 18 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771237:0:16911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905757 expref: 18 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771248:0:16911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771256:0:16911:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771265:0:16911:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771874:0:16911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.771894:0:16911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131442.771937:0:16911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400512:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131442.772133:0:16911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.772143:0:16911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131442.772151:0:16911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400640:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131442.772184:0:16911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 18 pid: 14786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.772194:0:16911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 18 pid: 14786 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131442.772204:0:16911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400768:0@lo:104: 00000100:00100000:2.0:1789131442.772256:0:16911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131442.772308:0:16911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 18 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.772315:0:16911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 18 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131442.772340:0:16911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400896:0@lo:104: 00000100:00100000:2.0:1789131442.772387:0:16911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789131442.772430:0:16911:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 18 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.772439:0:16911:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 18 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131442.772456:0:16911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910401024:0@lo:104: 00000100:00100000:2.0:1789131442.772485:0:16911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131442.772498:0:16911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5021a300 going to sleep for 11 seconds 00000100:00100000:3.0:1789131442.772583:0:14774:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789131442.772610:0:14774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400768 00000100:00100000:3.0:1789131442.772619:0:14774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400768 00000100:00100000:1.0:1789131442.772628:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910400896 00000100:00100000:1.0:1789131442.772632:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910400896 00000100:00100000:1.0:1789131442.772672:0:14775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401024 00000100:00100000:1.0:1789131442.772675:0:14775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401024 00000100:00100000:3.0:1789131442.772678:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131442.772688:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:16911:x1876039910400896:12345-0@lo:104: 00010000:00010000:3.0:1789131442.772705:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.772774:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789131442.772781:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+5:16911:x1876039910400896:12345-0@lo:104: Request processed in 94us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131442.772789:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131442.772810:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789131442.772816:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+4:16911:x1876039910400768:12345-0@lo:104: 00010000:00010000:3.0:1789131442.772824:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.772862:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789131442.772867:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+4:16911:x1876039910400768:12345-0@lo:104: Request processed in 52us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131442.772873:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789131442.772886:0:14774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789131442.772892:0:14774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c81c7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:16911:x1876039910401024:12345-0@lo:104: 00010000:00010000:3.0:1789131442.772900:0:14774:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.772901:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131442.772910:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.772919:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5600 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:1.0:1789131442.772923:0:14779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.772944:0:14774:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789131442.772944:0:14779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.772949:0:14774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c81c7f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+3:16911:x1876039910401024:12345-0@lo:104: Request processed in 57us (464us total) trans 0 rc 0/0 10000000:00010000:1.0:1789131442.772952:0:14779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.772955:0:14774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 10000000:01000000:1.0:1789131442.772960:0:14779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789131442.772995:0:14780:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789131442.772995:0:14779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773001:0:14780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773002:0:14779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789131442.773007:0:14780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c4400 already unused, calling callback (ffffffffc1b0bc20) 10000000:00010000:3.0:1789131442.773010:0:14780:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773017:0:14780:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789131442.773023:0:14780:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773025:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789131442.773030:0:14780:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789131442.773033:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5600/0x9f0de3718790561c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de37187905623 expref: -99 pid: 15474 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773041:0:14780:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773046:0:14780:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131442.773047:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789131442.773050:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773052:0:14780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773057:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742c5a00 already unused, calling callback (ffffffffc1b0bc20) 00010000:00010000:3.0:1789131442.773059:0:14780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c742c4400/0x9f0de37187905757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de3718790575e expref: -99 pid: 16197 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131442.773060:0:14779:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773066:0:14779:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789131442.773072:0:14779:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.773080:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131442.773082:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789131442.773083:0:14779:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789131442.773084:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131442.773090:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131442.773096:0:14779:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773101:0:14779:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789131442.773119:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.773126:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff9c0c742c5a00/0x9f0de371879055cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9f0de371879055d6 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.773130:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:1.0:1789131442.773140:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789131442.773142:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131442.773143:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3307:1876039910401408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789131442.773143:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789131442.773153:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910401152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789131442.773173:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131442.773197:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131442.773214:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789131442.773215:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401408 00000100:00100000:3.0:1789131442.773219:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401408 00000100:00100000:1.0:1789131442.773219:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910401280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131442.773240:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 19 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131442.773241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131442.773256:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401152 00000100:00100000:3.0:1789131442.773259:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401152 00010000:00010000:3.0:1789131442.773271:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 20 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.773282:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401280 00000100:00100000:3.0:1789131442.773284:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401280 00010000:00010000:3.0:1789131442.773296:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 21 pid: 14786 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.773307:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789131442.773313:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+21:3307:x1876039910401408:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789131442.773317:0:16911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400768:0@lo:104: 00010000:00010000:3.0:1789131442.773345:0:14777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789131442.775230:0:14776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789131442.775250:0:14776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1789131442.775368:0:16911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400896:0@lo:104: 00000100:00100000:2.0:1789131442.775399:0:16911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910401024:0@lo:104: 00000100:00100000:2.0:1789131442.775463:0:14778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789131442.775485:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131442.775499:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+21:3308:x1876039910401152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131442.775519:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131442.775532:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 21 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775547:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 21 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775570:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e15800/0x9f0de37187905623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de3718790561c expref: 21 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775598:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131442.775675:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+20:3308:x1876039910401152:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131442.775684:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789131442.775709:0:14778:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789131442.775716:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789131442.775723:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3308:x1876039910401280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789131442.775748:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131442.775753:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 19 pid: 14786 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775762:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 19 pid: 14786 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775773:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742c4e00/0x9f0de3718790575e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de37187905757 expref: 19 pid: 14786 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131442.775784:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131442.775811:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:3308:x1876039910401280:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (2568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131442.775818:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789131442.776076:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910401280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131442.776086:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3308:1876039910401152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789131442.779689:0:14777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 17 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.779947:0:14777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 17 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.779991:0:14777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c74e14000/0x9f0de371879055d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9f0de371879055cf expref: 17 pid: 14784 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.780011:0:14777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789131442.780285:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131442.780378:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a63d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:3307:x1876039910401408:12345-0@lo:103:ldlm_bl.0 Request processed in 7062us (7201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131442.780389:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789131442.780392:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631616 00000100:00100000:0.0:1789131442.780402:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631616 00010000:00010000:0.0:1789131442.780452:0:14778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 13 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131442.780483:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131442.780493:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2353:x1876039893631616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789131442.780509:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131442.780514:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 13 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131442.780525:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 13 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131442.780537:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131442.780582:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2353:x1876039893631616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 90us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131442.780598:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00010000:00010000:3.0:1789131442.780623:0:16911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0b42eb4200/0x9f0de371879058b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a52 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131442.780635:0:16911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a424b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400512:192.168.203.52@tcp:104: 00000100:00100000:3.0:1789131442.780647:0:16911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b42cf12c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16911:1876039910400640:192.168.203.52@tcp:104: 00010000:00010000:3.0:1789131442.780692:0:16911:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131442.780909:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3307:1876039910401408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789131442.782846:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131442.782960:0:16913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631744 00000100:00100000:1.0:1789131442.782970:0:16913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631744 00010000:00010000:1.0:1789131442.783018:0:16913:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131442.783064:0:16913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1789131442.783077:0:16913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:2353:x1876039893631744:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131442.783116:0:16913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131442.783123:0:16913:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783135:0:16913:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783157:0:16913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742b1a00/0x9f0de3718790587d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb0399f0 expref: 12 pid: 14785 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783177:0:16913:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783187:0:16913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783206:0:16913:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783213:0:16913:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783221:0:16913:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783229:0:16913:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783235:0:16913:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1200 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131442.783239:0:16913:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783258:0:16913:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783283:0:16913:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131442.783297:0:16913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789131442.783550:0:16911:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131442.783561:0:16911:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131442.783563:0:16913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:2353:x1876039893631744:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 488us (729us total) trans 0 rc 0/0 00010000:00010000:3.0:1789131442.783568:0:16911:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c0c742b1200/0x9f0de371879058df lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16911 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131442.783572:0:16913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:0.0:1789131443.551740:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789131444.570994:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789131444.697488:0:14788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789131444.697499:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c772ac800 from 13 10000000:01000000:3.0:1789131444.697506:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789131444.697606:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.697620:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.697660:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131444.697695:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.697793:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.697878:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131444.697993:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401536 00000100:00100000:2.0:1789131444.698006:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401536 00000100:00100000:2.0:1789131444.698085:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789131444.698111:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+16:14788:x1876039910401536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789131444.698135:0:14784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131444.698158:0:14784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0c742b1e00/0x9f0de371879058ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879058e6 expref: -99 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.698189:0:14784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0c742b1e00/0x9f0de371879058ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879058e6 expref: 17 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.698215:0:14784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0c742b1e00/0x9f0de371879058ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879058e6 expref: 17 pid: 14784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.698239:0:14784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1e00, rc 0) 00000100:00100000:2.0:1789131444.698294:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.698302:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789131444.698622:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131444.698641:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058ed expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.698652:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879058ed expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131444.698734:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.698767:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.698839:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c43840 going to sleep for 11 seconds 00000100:00100000:0.0:1789131444.700299:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401664 00000100:00100000:0.0:1789131444.700312:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401664 00000100:00100000:0.0:1789131444.700465:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789131444.700477:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789131444.700915:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 439us (2145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131444.700925:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789131444.702547:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.702665:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.702758:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.703355:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131444.703496:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401792 00000100:00100000:2.0:1789131444.703505:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401792 00000100:00100000:2.0:1789131444.703991:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789131444.704007:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.706054:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2039us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.706071:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789131444.714215:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401792:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789131444.722780:0:16991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789131444.729305:0:14788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789131444.729385:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789131444.729402:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058ed expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.729428:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0b41cea600/0x9f0de371879058e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058ed expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131444.729674:0:14788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131444.729678:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43123000 from 13 10000000:01000000:2.0:1789131444.729682:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131444.729739:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.729748:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.729761:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131444.729794:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.729900:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131444.729967:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5021a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789131444.730057:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910401920 00000100:00100000:1.0:1789131444.730068:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910401920 00000100:00100000:1.0:1789131444.730143:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789131444.730155:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+17:14788:x1876039910401920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131444.730175:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131444.730192:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb4c00/0x9f0de371879058fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de371879058f4 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.730223:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb4c00/0x9f0de371879058fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de371879058f4 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.730234:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb4c00/0x9f0de371879058fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de371879058f4 expref: 18 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.730245:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb4c00, rc 0) 00000100:00100000:1.0:1789131444.730303:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910401920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131444.730310:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789131444.730638:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910401920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131444.730656:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058fb expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.730667:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de371879058fb expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131444.730740:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.730778:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.730812:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c43840 going to sleep for 11 seconds 00000100:00100000:1.0:1789131444.730858:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402048 00000100:00100000:1.0:1789131444.730864:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402048 00000100:00100000:1.0:1789131444.730899:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789131444.730908:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910402048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131444.731255:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910402048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131444.731263:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789131444.731591:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.731636:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.731684:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.731716:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c43840 going to sleep for 11 seconds 00000100:00100000:2.0:1789131444.731760:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402176 00000100:00100000:2.0:1789131444.731765:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402176 00000100:00100000:2.0:1789131444.731803:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789131444.731811:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910402176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.732004:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910402176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.732011:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789131444.732204:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789131444.733191:0:16993:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789131444.733496:0:14788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789131444.733526:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789131444.733539:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058fb expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.733552:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742b1800/0x9f0de371879058f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de371879058fb expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789131444.733565:0:14788:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789131444.733568:0:14788:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c0c43172000 from 13 10000000:01000000:2.0:1789131444.733580:0:14788:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789131444.733627:0:14788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.733637:0:14788:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131444.733650:0:14788:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131444.733676:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.733752:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131444.733788:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c5590d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131444.733836:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402304 00000100:00100000:1.0:1789131444.733844:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402304 00000100:00100000:1.0:1789131444.733896:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789131444.733907:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+18:14788:x1876039910402304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789131444.733922:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131444.733939:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b42eb5e00/0x9f0de37187905909 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9f0de37187905902 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.733964:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b42eb5e00/0x9f0de37187905909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9f0de37187905902 expref: 19 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.733975:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b42eb5e00/0x9f0de37187905909 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9f0de37187905902 expref: 19 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131444.733983:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb5e00, rc 0) 00000100:00100000:1.0:1789131444.734035:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910402304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131444.734042:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789131444.734254:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131444.734271:0:14788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905909 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.734281:0:14788:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9f0de37187905909 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131444.734385:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.734420:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.734437:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131444.734491:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402432 00000100:00100000:2.0:1789131444.734496:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402432 00000100:00100000:2.0:1789131444.734534:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789131444.734541:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910402432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.734853:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910402432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.734860:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789131444.735875:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.735935:0:14788:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.736001:0:14788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131444.736043:0:14788:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c47c433c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789131444.736680:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402560 00000100:00100000:2.0:1789131444.736691:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402560 00000100:00100000:2.0:1789131444.736747:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789131444.736758:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910402560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.736994:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a7fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:14788:x1876039910402560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.737003:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789131444.738354:0:14788:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:14788:1876039910402560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789131444.740630:0:16994:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789131444.741455:0:14788:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789131444.741490:0:14788:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789131444.741506:0:14788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905909 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.741519:0:14788:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff9c0c742b0800/0x9f0de37187905902 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9f0de37187905909 expref: -99 pid: 14788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131444.743190:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131444.743455:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893631872 00000100:00100000:3.0:1789131444.743468:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893631872 00000100:00100000:3.0:1789131444.743531:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1789131444.743544:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+11:13958:x1876039893631872:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131444.743583:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131444.743607:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41ceb600/0x9f0de37187905910 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a83 expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.743642:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41ceb600/0x9f0de37187905910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a83 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.743673:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41ceb600/0x9f0de37187905910 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a83 expref: 12 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.743683:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41ceb600, rc 0) 00000100:00100000:3.0:1789131444.743760:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893631872:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 218us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131444.743769:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1789131444.747820:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131444.747921:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632000 00000100:00100000:1.0:1789131444.747933:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632000 00000100:00100000:1.0:1789131444.748001:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1789131444.748026:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893632000:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789131444.748416:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893632000:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 393us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131444.748425:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:0.0:1789131444.751860:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131444.751953:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632128 00000100:00100000:3.0:1789131444.751966:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632128 00000100:00100000:3.0:1789131444.752037:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1789131444.752049:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893632128:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.752465:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893632128:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 416us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131444.752474:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:1.0:1789131444.774553:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131444.774648:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632256 00000100:00100000:3.0:1789131444.774660:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632256 00000100:00100000:3.0:1789131444.774731:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1789131444.774743:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+12:13958:x1876039893632256:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789131444.774766:0:14785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789131444.774790:0:14785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c0b41cea200/0x9f0de37187905917 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a8a expref: -99 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.774826:0:14785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c0b41cea200/0x9f0de37187905917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a8a expref: 13 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.774838:0:14785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c0b41cea200/0x9f0de37187905917 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a8a expref: 13 pid: 14785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131444.774860:0:14785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b41cea200, rc 0) 00000100:00100000:3.0:1789131444.774936:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:13958:x1876039893632256:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 194us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131444.774944:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1789131444.779531:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131444.779595:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632384 00000100:00100000:3.0:1789131444.779609:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632384 00000100:00100000:3.0:1789131444.779673:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1789131444.779685:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:13958:x1876039893632384:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789131444.780057:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:13958:x1876039893632384:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 371us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131444.780066:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1789131444.790039:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131444.790171:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632512 00000100:00100000:2.0:1789131444.790184:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632512 00000100:00100000:2.0:1789131444.790279:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:2.0:1789131444.790290:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:13958:x1876039893632512:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789131444.790672:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:13958:x1876039893632512:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 381us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131444.790682:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:1.0:1789131445.210196:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910402688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789131445.210299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131445.210968:0:15480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402688 00000100:00100000:3.0:1789131445.210980:0:15480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402688 00000100:00100000:3.0:1789131445.211056:0:15480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131445.211070:0:15480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910402688:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789131445.211077:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789131445.211125:0:15480:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131445.211189:0:15480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1876039910402688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131445.211196:0:15480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789131445.211228:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910403200:0@lo:400:kworker.0 00000100:00100000:3.0:1789131445.211259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131445.211305:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1876039910402688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131445.211353:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789131445.211385:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910403072:0@lo:400:kworker.0 00000100:00100000:3.0:1789131445.211411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131445.212172:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910402944:0@lo:400:kworker.0 00000100:00100000:0.0:1789131445.212177:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910403200 00000100:00100000:0.0:1789131445.212183:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910403200 00000100:00100000:2.0:1789131445.212219:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131445.212230:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910403072 00000100:00100000:0.0:1789131445.212234:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910403072 00000100:00100000:0.0:1789131445.212253:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789131445.212255:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789131445.212262:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910402816:0@lo:400:kworker.0 00000100:00100000:0.0:1789131445.212262:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910403200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.212293:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131445.213426:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402944 00000100:00100000:1.0:1789131445.213439:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402944 00000100:00100000:1.0:1789131445.213500:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789131445.213511:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910402944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.213639:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910403328:0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.213700:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131445.213740:0:14785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910402816 00000100:00100000:2.0:1789131445.213745:0:14785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910402816 00000100:00100000:2.0:1789131445.213778:0:14785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789131445.213785:0:14785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3309:x1876039910402816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.213826:0:14785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3309:x1876039910402816:12345-0@lo:400:kworker.0 Request processed in 40us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131445.213834:0:14785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:2.0:1789131445.213871:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789131445.213877:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131445.213907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910402816:0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.213976:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910403328 00000100:00100000:2.0:1789131445.213980:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910403328 00000100:00100000:2.0:1789131445.214008:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131445.214015:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a424b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910403072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.214052:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a424b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910403072:12345-0@lo:400:kworker.0 Request processed in 37us (2639us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131445.214060:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789131445.214077:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789131445.214083:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910403328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.214114:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910403328:12345-0@lo:400:kworker.0 Request processed in 31us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131445.214138:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789131445.214153:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131445.214173:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910403328:0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.214202:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910403072:0@lo:400:kworker.0 00000100:00100000:2.0:1789131445.214216:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1876039910403200:0@lo:400:kworker.0 00000100:00100000:0.0:1789131445.216035:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a4261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1876039910403200:12345-0@lo:400:kworker.0 Request processed in 3761us (4761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131445.216053:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789131445.218547:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910402944:12345-0@lo:400:kworker.0 Request processed in 5021us (6309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131445.218577:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789131445.218818:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a63d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910402944:0@lo:400:kworker.0 00010000:00010000:1.0:1789131445.598430:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131446.233654:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a426940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910403456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789131446.233774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131446.233966:0:15480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910403456 00000100:00100000:3.0:1789131446.233979:0:15480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910403456 00000100:00100000:3.0:1789131446.234051:0:15480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789131446.234063:0:15480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910403456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131446.234111:0:15480:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131446.234224:0:15480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910403456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131446.234233:0:15480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789131446.237814:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a426940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910403456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789131446.325871:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.326200:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632640 00000100:00100000:0.0:1789131446.326213:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632640 00000100:00100000:0.0:1789131446.326317:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1789131446.326370:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+6:14617:x1876039893632640:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131446.326398:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.326429:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790591e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a91 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.326930:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.326949:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.326968:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.326987:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.326994:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.327001:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789131446.328054:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789131446.329067:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187905933 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.329090:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187905933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.329104:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187905933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.329217:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1789131446.329223:0:14793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131446.334213:0:14793:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187905933 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334276:0:14793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334283:0:14793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334291:0:14793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334298:0:14793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.334304:0:14793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334313:0:14793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334351:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:0.0:1789131446.334356:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.334362:0:14793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334369:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334388:0:14793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334394:0:14793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334399:0:14793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334411:0:14793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.334415:0:14793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334421:0:14793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334430:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c0c4392c200) 00010000:00010000:0.0:1789131446.334432:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.334435:0:14793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334441:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de3718790592c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334511:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790591e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a91 expref: 8 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334529:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f400/0x9f0de37187905933 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a91 expref: 7 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.334536:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c4392cc00) 00010000:00010000:0.0:1789131446.334539:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131446.334541:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f400, rc 0) 00000100:00100000:0.0:1789131446.334663:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a426940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+7:14617:x1876039893632640:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8297us (8806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.334674:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1789131446.340791:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.341094:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893632896 00000100:00100000:2.0:1789131446.341172:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893632896 00000100:00100000:2.0:1789131446.341249:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1789131446.341263:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+7:14617:x1876039893632896:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131446.341292:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.341412:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de3718790593a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a98 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341519:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341537:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341551:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341601:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341609:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.341617:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.343198:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de3718790594f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.343220:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de3718790594f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.343232:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de3718790594f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.343246:0:14791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1789131446.344348:0:14791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344363:0:14791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344370:0:14791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344376:0:14791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131446.344382:0:14791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344403:0:14791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344421:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c0c4392cc00) 00010000:00010000:2.0:1789131446.344425:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.344432:0:14791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344440:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905941 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344456:0:14791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344463:0:14791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344470:0:14791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344475:0:14791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131446.344478:0:14791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344484:0:14791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344491:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c0c5855be00) 00010000:00010000:2.0:1789131446.344494:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.344739:0:14791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.344759:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905948 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.345891:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de3718790593a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a98 expref: 10 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.346070:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0200/0x9f0de3718790594f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a98 expref: 9 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.346080:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131446.346084:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.346087:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0200, rc 0) 00000100:00100000:2.0:1789131446.346350:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+9:14617:x1876039893632896:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5088us (5573us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789131446.346361:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1789131446.365228:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.367123:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633024 00000100:00100000:2.0:1789131446.367145:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633024 00000100:00100000:2.0:1789131446.367247:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1789131446.367261:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+9:14617:x1876039893633024:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789131446.367465:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+9:14617:x1876039893633024:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 206us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131446.367475:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1789131446.390765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.391011:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633152 00000100:00100000:0.0:1789131446.391044:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633152 00000100:00100000:0.0:1789131446.391133:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1789131446.391146:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+9:14623:x1876039893633152:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131446.391175:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.391204:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790595d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039a9f expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391291:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391374:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391389:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391407:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391415:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.391421:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393379:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393404:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393412:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393431:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.393437:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393448:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393471:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:0.0:1789131446.393475:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.393480:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393488:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393579:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393587:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393594:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393600:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473fa00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.393603:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393610:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393629:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131446.393632:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.393636:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393717:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de3718790596b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393783:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790595d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a9f expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393796:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:0.0:1789131446.393798:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.393802:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790595d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a9f expref: 10 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.393812:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e400, rc 0) 00000100:00100000:0.0:1789131446.394008:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+9:14623:x1876039893633152:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2861us (3258us total) trans 0 rc 301/301 00000100:00100000:0.0:1789131446.394019:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1789131446.409462:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.409651:0:14800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633280 00000100:00100000:0.0:1789131446.409665:0:14800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633280 00000100:00100000:0.0:1789131446.409730:0:14800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1789131446.409742:0:14800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f0519b8-1f34-4031-b607-119670debea2+9:14623:x1876039893633280:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:0.0:1789131446.409846:0:14800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8f0519b8-1f34-4031-b607-119670debea2+9:14623:x1876039893633280:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 106us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.409854:0:14800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1789131446.415780:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.419864:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633536 00000100:00100000:2.0:1789131446.419884:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633536 00000100:00100000:2.0:1789131446.419999:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1789131446.420012:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+9:14623:x1876039893633536:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:2.0:1789131446.420124:0:15748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131446.420163:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de371879058a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a1a expref: 9 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.420189:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.420196:0:15748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131446.421279:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.421305:0:15748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 5 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.421315:0:15748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.421722:0:15748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 5 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.421742:0:15748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 5 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131446.421765:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403584:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131446.421948:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea000 going to sleep for 11 seconds 00000100:00100000:0.0:1789131446.431413:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.431514:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633664 00000100:00100000:1.0:1789131446.431526:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633664 00010000:00010000:1.0:1789131446.431612:0:14778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 6 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131446.431672:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1789131446.431685:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:625380bf-5b63-443b-85ed-920fb77537b0+6:2352:x1876039893633664:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131446.431725:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131446.431735:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 6 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.431751:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 6 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.431785:0:14778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:1.0:1789131446.431791:0:14778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.431803:0:14778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.431813:0:14778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.431835:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131446.431903:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:625380bf-5b63-443b-85ed-920fb77537b0+6:2352:x1876039893633664:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 219us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.431912:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:3.0:1789131446.432283:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789131446.434206:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de371879058d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039a7c expref: 5 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131446.434237:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403584:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131446.434271:0:15748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.434663:0:15748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.434670:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.434704:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.434720:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.434733:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.439855:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789131446.439883:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439895:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439903:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439911:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131446.439916:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439926:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439965:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.439968:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.439975:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.439983:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905972 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131446.440032:0:15748:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000aa0d5f67 reply state 0000000013d1ae52 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131446.440043:0:15748:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131446.440372:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+10:14623:x1876039893633536:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 20310us (24554us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789131446.440716:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:1.0:1789131446.443856:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443883:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443893:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443920:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131446.443926:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443935:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443959:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0c5855be00) 00010000:00010000:1.0:1789131446.443963:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131446.443969:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.443977:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905979 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131446.532966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.533016:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.533050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.533091:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.533120:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.533152:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634048 00000100:00100000:1.0:1789131446.533164:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634048 00000100:00100000:1.0:1789131446.533235:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634304 00000100:00100000:1.0:1789131446.533239:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634304 00000100:00100000:1.0:1789131446.533254:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633920 00000100:00100000:1.0:1789131446.533257:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633920 00000100:00100000:1.0:1789131446.533268:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634176 00000100:00100000:1.0:1789131446.533270:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634176 00000100:00100000:1.0:1789131446.533287:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1789131446.533298:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+5:2352:x1876039893634048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131446.533523:0:15478:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789131446.533536:0:15478:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789131446.533708:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1789131446.533717:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2352:x1876039893634304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131446.533803:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2352:x1876039893634304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 87us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131446.533812:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1789131446.533833:0:15478:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789131446.533842:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131446.533848:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2352:x1876039893633920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131446.533877:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2352:x1876039893633920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131446.533883:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1789131446.533905:0:15478:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789131446.533912:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1789131446.533919:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2352:x1876039893634176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1789131446.533945:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:2352:x1876039893634176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131446.533951:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00080000:3.0:1789131446.534081:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789131446.534087:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131446.534761:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+5:2352:x1876039893634048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1333us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.534774:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1789131446.535928:0:14786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893633792 00000100:00100000:2.0:1789131446.535943:0:14786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893633792 00000100:00100000:2.0:1789131446.536013:0:14786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1789131446.536025:0:14786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2352:x1876039893633792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1789131446.536101:0:14786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2c6d23b2-2b9c-4db1-8d49-bb5aefdc60e5+13:2352:x1876039893633792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (3150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131446.536108:0:14786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:1.0:1789131446.552418:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.552518:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634432 00000100:00100000:2.0:1789131446.552530:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634432 00000100:00100000:2.0:1789131446.552604:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1789131446.552616:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+9:14631:x1876039893634432:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:2.0:1789131446.552664:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.552712:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039aa6 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.552794:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905987 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.552810:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.552822:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.552896:0:14791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1789131446.552900:0:14791:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131446.552959:0:14791:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905987 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.552987:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aa6 expref: 11 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.553009:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0a00/0x9f0de37187905987 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aa6 expref: 10 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.553019:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.553022:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789131446.553026:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0a00, rc 0) 00000100:00100000:2.0:1789131446.554207:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+10:14631:x1876039893634432:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 1583us (1794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131446.554220:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1789131446.596955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.597215:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634560 00000100:00100000:0.0:1789131446.597228:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634560 00000100:00100000:0.0:1789131446.597307:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1789131446.597474:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:625380bf-5b63-443b-85ed-920fb77537b0+5:14632:x1876039893634560:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131446.597571:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.597600:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790598e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039aad expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.597777:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905995 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.597796:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.597810:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.597891:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1789131446.597897:0:14793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131446.597963:0:14793:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905995 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.597995:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790598e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aad expref: 7 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.598018:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fa00/0x9f0de37187905995 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aad expref: 6 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.598028:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:0.0:1789131446.598039:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131446.598044:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fa00, rc 0) 00000100:00100000:0.0:1789131446.601993:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:625380bf-5b63-443b-85ed-920fb77537b0+6:14632:x1876039893634560:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 4654us (5034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.602010:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1789131446.613646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.613782:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634688 00000100:00100000:0.0:1789131446.613795:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634688 00000100:00100000:0.0:1789131446.613873:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1789131446.613884:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+6:14632:x1876039893634688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131446.613913:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.613940:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790599c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ab4 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614021:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614038:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614051:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614079:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614088:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614096:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614256:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614265:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614272:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.614363:0:14792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789131446.614368:0:14792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131446.614398:0:14792:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614413:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614420:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614427:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614445:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.614450:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614459:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.614474:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:0.0:1789131446.614487:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.614494:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615580:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de371879059a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615605:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615611:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615618:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615624:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473ec00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.615628:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615636:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615648:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131446.615652:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.615656:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615661:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615842:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de3718790599c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ab4 expref: 8 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615884:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ab4 expref: 7 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.615893:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392cb00) 00010000:00010000:0.0:1789131446.615896:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131446.615899:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e000, rc 0) 00000100:00100000:0.0:1789131446.616236:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+7:14632:x1876039893634688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2351us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.616248:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:0.0:1789131446.618933:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789131446.620837:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.622870:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893634944 00000100:00100000:1.0:1789131446.622894:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893634944 00000100:00100000:1.0:1789131446.624819:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1789131446.624852:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+7:14632:x1876039893634944:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1789131446.624885:0:15748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131446.624918:0:15748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de371879059b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039abb expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131446.625095:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1789131446.625271:0:15748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de371879059b8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039abb expref: 9 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.625290:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:1.0:1789131446.625293:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131446.625298:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de371879059b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039abb expref: 9 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.625317:0:15748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb4600, rc 0) 00000100:00100000:1.0:1789131446.625746:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:625380bf-5b63-443b-85ed-920fb77537b0+8:14632:x1876039893634944:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 908us (4921us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1789131446.625755:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:3.0:1789131446.628594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.628688:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893635200 00000100:00100000:2.0:1789131446.628701:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893635200 00000100:00100000:2.0:1789131446.628779:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1789131446.628791:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:625380bf-5b63-443b-85ed-920fb77537b0+8:14632:x1876039893635200:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:2.0:1789131446.628867:0:14791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131446.628903:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e000/0x9f0de371879059b1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ab4 expref: 8 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.628926:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392cb00) 00010000:00010000:2.0:1789131446.628942:0:14791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131446.628979:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.628995:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.629005:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131446.629978:0:14791:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a7dd530d reply state 0000000041d04efc transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131446.629997:0:14791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789131446.630012:0:14791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1789131446.633441:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b42cf30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:625380bf-5b63-443b-85ed-920fb77537b0+9:14632:x1876039893635200:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 4635us (4846us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789131446.633457:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00010000:00010000:0.0:1789131446.635886:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635909:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635918:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635925:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.635931:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635939:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635960:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c5855b600) 00010000:00010000:0.0:1789131446.635964:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789131446.635989:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.635996:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059c6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131446.637742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.638740:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893635456 00000100:00100000:0.0:1789131446.638755:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893635456 00000100:00100000:0.0:1789131446.638836:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1789131446.638848:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+8:14632:x1876039893635456:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1789131446.639614:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+9:14632:x1876039893635456:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 761us (1879us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789131446.639625:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1789131446.646435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.647507:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893635712 00000100:00100000:2.0:1789131446.647524:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893635712 00000100:00100000:2.0:1789131446.647711:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1789131446.647746:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:625380bf-5b63-443b-85ed-920fb77537b0+9:14632:x1876039893635712:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131446.647783:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.647811:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879059cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ac2 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647920:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647940:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647959:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647978:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647985:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.647991:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.648160:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789131446.648286:0:14793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648292:0:14793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648298:0:14793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648311:0:14793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131446.648315:0:14793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648376:0:14793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648392:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.648395:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.648400:0:14793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648407:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de371879059d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648422:0:14793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648428:0:14793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648433:0:14793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648437:0:14793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131446.648440:0:14793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648447:0:14793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648466:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0c5855bb00) 00010000:00010000:2.0:1789131446.648469:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131446.648472:0:14793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648478:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de371879059db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648526:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879059cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac2 expref: 11 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648537:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.648540:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131446.648543:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de371879059cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac2 expref: 11 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.648552:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1200, rc 0) 00000100:00100000:2.0:1789131446.648651:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:625380bf-5b63-443b-85ed-920fb77537b0+10:14632:x1876039893635712:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 908us (2231us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789131446.648660:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1789131446.651867:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.653294:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893635840 00000100:00100000:0.0:1789131446.653312:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893635840 00000100:00100000:0.0:1789131446.653440:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1789131446.653453:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+10:14632:x1876039893635840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131446.653487:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.653517:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de371879059e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ac9 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.653653:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.653670:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.653685:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.654761:0:14792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1789131446.654962:0:14792:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789131446.655017:0:14792:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.655061:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de371879059e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 12 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.655083:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 11 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.655094:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131446.655097:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789131446.655101:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ec00, rc 0) 00000100:00100000:0.0:1789131446.656617:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:625380bf-5b63-443b-85ed-920fb77537b0+11:14632:x1876039893635840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 3151us (4816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.656632:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:3.0:1789131446.663015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.663582:0:14794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893635968 00000100:00100000:0.0:1789131446.663596:0:14794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893635968 00000100:00100000:0.0:1789131446.663667:0:14794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1789131446.663679:0:14794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:625380bf-5b63-443b-85ed-920fb77537b0+11:14632:x1876039893635968:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:0.0:1789131446.674095:0:14794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:625380bf-5b63-443b-85ed-920fb77537b0+11:14632:x1876039893635968:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 10090us (10766us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131446.674114:0:14794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1789131446.678742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.679505:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893636224 00000100:00100000:1.0:1789131446.679519:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893636224 00000100:00100000:1.0:1789131446.679638:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1789131446.679651:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5fcd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+11:14632:x1876039893636224:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131446.680376:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5fcd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:625380bf-5b63-443b-85ed-920fb77537b0+12:14632:x1876039893636224:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 724us (1647us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789131446.680387:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1789131446.748767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.749474:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893636352 00000100:00100000:1.0:1789131446.749488:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893636352 00000100:00100000:1.0:1789131446.749640:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1789131446.749653:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+10:14638:x1876039893636352:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1789131446.749681:0:15748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131446.749707:0:15748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de371879059f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ad0 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749791:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749809:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749822:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749840:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749847:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.749875:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750016:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4800/0x9f0de37187905a0c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750025:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4800/0x9f0de37187905a0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750033:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4800/0x9f0de37187905a0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789131446.750071:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:1.0:1789131446.750075:0:15748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789131446.750123:0:15748:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4800/0x9f0de37187905a0c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750138:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750145:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750152:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750159:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb4000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131446.750164:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750173:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750196:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:1.0:1789131446.750199:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131446.750206:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750213:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4000/0x9f0de371879059fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750230:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750247:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750252:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750258:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb5200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131446.750261:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750267:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750274:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c0c50477e00) 00010000:00010000:1.0:1789131446.750276:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131446.750279:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750285:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750405:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de371879059f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad0 expref: 12 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750421:0:15748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4800/0x9f0de37187905a0c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad0 expref: 11 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.750430:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131446.750432:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789131446.750435:0:15748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb4800, rc 0) 00000100:00100000:1.0:1789131446.750520:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+11:14638:x1876039893636352:12345-192.168.203.52@tcp:101:bash.0 Request processed in 870us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.750528:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1789131446.754852:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.754970:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893636608 00000100:00100000:2.0:1789131446.754982:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893636608 00000100:00100000:2.0:1789131446.755059:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1789131446.755072:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+11:14638:x1876039893636608:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131446.755103:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.755131:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a13 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ad7 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.755515:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.755533:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 11 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.755544:0:14791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.755599:0:14791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 11 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.755614:0:14791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 11 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131446.755629:0:14791:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14791:1876039910403712:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131446.755786:0:14791:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131446.759799:0:14791:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14791:1876039910403712:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131446.759844:0:14791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131446.761589:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.761667:0:16913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893636736 00000100:00100000:1.0:1789131446.761679:0:16913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893636736 00010000:00010000:1.0:1789131446.761737:0:16913:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 12 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131446.762029:0:16913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1789131446.762042:0:16913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:625380bf-5b63-443b-85ed-920fb77537b0+12:2353:x1876039893636736:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131446.762061:0:16913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131446.762070:0:16913:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 12 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762087:0:16913:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 12 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762140:0:16913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ec00/0x9f0de371879059f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ac9 expref: 12 pid: 14792 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762174:0:16913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:1.0:1789131446.762182:0:16913:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762194:0:16913:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762202:0:16913:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.762251:0:16913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789131446.762374:0:14791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131446.762392:0:16913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:625380bf-5b63-443b-85ed-920fb77537b0+11:2353:x1876039893636736:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 352us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.762402:0:16913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:0.0:1789131446.763243:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.763279:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.763291:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.763303:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765440:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765464:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765478:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.765492:0:14791:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789131446.765526:0:14791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765534:0:14791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765541:0:14791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765548:0:14791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131446.765576:0:14791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765586:0:14791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765601:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:0.0:1789131446.765604:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131446.765609:0:14791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765616:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905a1a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789131446.765631:0:14791:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000028aa4568 reply state 000000006c73f47d transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131446.765640:0:14791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789131446.765698:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a13 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 14 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765715:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 13 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.765723:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131446.765725:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789131446.765728:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e600, rc 0) 00000100:00100000:0.0:1789131446.765832:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+14:14638:x1876039893636608:12345-192.168.203.52@tcp:101:bash.0 Request processed in 10762us (10995us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789131446.765843:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:1.0:1789131446.774214:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.774237:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.774246:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.774253:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131446.774259:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.774298:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.775169:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c0c4392c000) 00010000:00010000:1.0:1789131446.775182:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131446.775192:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.775201:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e400/0x9f0de37187905a21 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131446.784843:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.785625:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893636864 00000100:00100000:2.0:1789131446.785644:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893636864 00000100:00100000:2.0:1789131446.785964:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1789131446.785977:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c568483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+13:14638:x1876039893636864:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1789131446.786011:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.786060:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ade expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786173:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786193:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786208:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.786260:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789131446.786265:0:14793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131446.786293:0:14793:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786307:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786374:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 15 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786470:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 14 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.786482:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:2.0:1789131446.786486:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131446.786491:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1400, rc 0) 00000100:00100000:2.0:1789131446.786647:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c568483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+14:14638:x1876039893636864:12345-192.168.203.52@tcp:101:bash.0 Request processed in 673us (2337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131446.786676:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1789131446.790957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.791186:0:14794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893637120 00000100:00100000:0.0:1789131446.791198:0:14794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893637120 00000100:00100000:0.0:1789131446.791302:0:14794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131446.791315:0:14794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+14:14638:x1876039893637120:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1789131446.791982:0:14794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+15:14638:x1876039893637120:12345-192.168.203.52@tcp:35:bash.0 Request processed in 664us (1036us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789131446.791993:0:14794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1789131446.883020:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131446.883120:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893637376 00000100:00100000:2.0:1789131446.883133:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893637376 00000100:00100000:2.0:1789131446.883207:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1789131446.883218:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+15:14648:x1876039893637376:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1789131446.883249:0:15748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131446.883278:0:15748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039ae5 expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131446.883467:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1789131446.883636:0:15748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a44 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ae5 expref: 17 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.883652:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c0c5855bc00) 00010000:00010000:2.0:1789131446.883656:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789131446.883662:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ae5 expref: 17 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131446.883679:0:15748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b0e00, rc 0) 00000100:00100000:2.0:1789131446.883757:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+16:14648:x1876039893637376:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 541us (753us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789131446.883765:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:3.0:1789131446.887315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.887992:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893637632 00000100:00100000:1.0:1789131446.888005:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893637632 00000100:00100000:1.0:1789131446.888072:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1789131446.888084:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+16:14648:x1876039893637632:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131446.888762:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+17:14648:x1876039893637632:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 673us (1455us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789131446.888773:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1789131446.931451:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131446.931646:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893637888 00000100:00100000:0.0:1789131446.931661:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893637888 00000100:00100000:0.0:1789131446.931738:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1789131446.931750:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+17:14651:x1876039893637888:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1789131446.931782:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131446.931808:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a52 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039aec expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.931938:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905a59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.931969:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.931984:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905a59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131446.931998:0:14792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789131446.932176:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a52 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aec expref: 20 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.932199:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905a59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aec expref: 19 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131446.932228:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131446.932232:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131446.932237:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f200, rc 0) 00000100:00100000:0.0:1789131446.932314:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+19:14651:x1876039893637888:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 565us (879us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789131446.933903:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1789131446.936833:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.936938:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893638016 00000100:00100000:1.0:1789131446.936951:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893638016 00000100:00100000:1.0:1789131446.937030:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1789131446.937042:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+19:14651:x1876039893638016:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1789131446.937126:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937147:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937178:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937212:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937220:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937228:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937235:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb4600 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131446.937241:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937250:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937264:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131446.937267:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789131446.937273:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.937279:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131446.937400:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+19:14651:x1876039893638016:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 359us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.937409:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1789131446.941679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.941746:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893638272 00000100:00100000:1.0:1789131446.941760:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893638272 00000100:00100000:1.0:1789131446.941841:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1789131446.941853:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+19:14651:x1876039893638272:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1789131446.942187:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+20:14651:x1876039893638272:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 335us (523us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789131446.942197:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1789131446.943465:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131446.943513:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893638400 00000100:00100000:1.0:1789131446.943525:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893638400 00000100:00100000:1.0:1789131446.943606:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1789131446.943616:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+20:2354:x1876039893638400:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131446.943633:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131446.943666:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f200/0x9f0de37187905a59 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039aec expref: 20 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131446.943689:0:14778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131446.943706:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131446.943755:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+19:2354:x1876039893638400:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 140us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131446.943763:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000040:00080000:0.0:1789131447.004628:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789131447.303665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131447.304056:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893638656 00000100:00100000:2.0:1789131447.304121:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893638656 00000100:00100000:2.0:1789131447.304464:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1789131447.304479:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+19:14682:x1876039893638656:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1789131447.305421:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131447.305451:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a6e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039af3 expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.305611:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.305630:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.305648:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131447.305663:0:14793:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789131447.305868:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905a6e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039af3 expref: 22 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.305893:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039af3 expref: 21 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.305903:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:2.0:1789131447.305907:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789131447.305911:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1200, rc 0) 00000100:00100000:2.0:1789131447.306015:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+21:14682:x1876039893638656:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1541us (2368us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789131447.306026:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1789131447.311885:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131447.311944:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131447.312036:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639040 00000100:00100000:3.0:1789131447.312068:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639040 00000100:00100000:3.0:1789131447.312178:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1789131447.312192:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f0519b8-1f34-4031-b607-119670debea2+21:2354:x1876039893639040:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789131447.312215:0:14777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789131447.312250:0:14777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905a75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039af3 expref: 21 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131447.312278:0:14777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:3.0:1789131447.312285:0:14777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789131447.312414:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f0519b8-1f34-4031-b607-119670debea2+20:2354:x1876039893639040:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 225us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131447.312422:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1789131447.313564:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893638912 00000100:00100000:1.0:1789131447.313575:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893638912 00000100:00100000:1.0:1789131447.313633:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1789131447.313642:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+20:14682:x1876039893638912:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1789131447.314075:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+21:14682:x1876039893638912:12345-192.168.203.52@tcp:35:cat.0 Request processed in 431us (2206us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1789131447.314101:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1789131447.379683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131447.379897:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639296 00000100:00100000:1.0:1789131447.379910:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639296 00000100:00100000:1.0:1789131447.379988:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1789131447.379999:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+21:14688:x1876039893639296:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:1.0:1789131447.380033:0:15748:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789131447.380062:0:15748:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a83 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039afa expref: -99 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380209:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380226:0:15748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380236:0:15748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 22 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380245:0:15748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380286:0:15748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 22 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380303:0:15748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 22 pid: 14793 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131447.380319:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403840:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131447.380515:0:15748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.380524:0:15748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131447.380532:0:15748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c42d88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403968:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131447.380564:0:15748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0b43a156c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789131447.392570:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0b41d86d00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403840:192.168.203.52@tcp:104: 00000100:00100000:1.0:1789131447.392590:0:15748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c42d88b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15748:1876039910403968:192.168.203.52@tcp:104: 00010000:00010000:1.0:1789131447.392627:0:15748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131447.393570:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131447.393688:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131447.394221:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639424 00000100:00100000:1.0:1789131447.394232:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639424 00010000:00010000:1.0:1789131447.394288:0:14778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 23 pid: 14793 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131447.394530:0:14778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639552 00000100:00100000:1.0:1789131447.394534:0:14778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639552 00010000:00010000:1.0:1789131447.394560:0:14778:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 24 pid: 14791 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131447.394682:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131447.394694:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7aa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+24:2354:x1876039893639424:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131447.394716:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131447.394745:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 24 pid: 14793 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.394759:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 24 pid: 14793 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.394787:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905a3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ade expref: 24 pid: 14793 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.394808:0:14778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131447.394814:0:14778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.394825:0:14778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.394833:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131447.394905:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7aa5d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+23:2354:x1876039893639424:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 212us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131447.394913:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1789131447.394970:0:14778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1789131447.394977:0:14778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+22:2354:x1876039893639552:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131447.394985:0:14778:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131447.394991:0:14778:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395001:0:14778:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395027:0:14778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e600/0x9f0de37187905a28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039ad7 expref: 22 pid: 14791 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395039:0:14778:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131447.395042:0:14778:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395051:0:14778:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395059:0:14778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131447.395087:0:14778:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131447.395108:0:14778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8f0519b8-1f34-4031-b607-119670debea2+21:2354:x1876039893639552:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 131us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131447.395115:0:14778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00010000:00010000:2.0:1789131447.395703:0:15748:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.395716:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131447.395742:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789131447.395987:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb4600/0x9f0de37187905a83 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039afa expref: 22 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.396007:0:15748:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5200/0x9f0de37187905a8a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039afa expref: 21 pid: 15748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.396015:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:2.0:1789131447.396018:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789131447.396021:0:15748:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0b42eb5200, rc 0) 00000100:00100000:2.0:1789131447.396066:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+21:14688:x1876039893639296:12345-192.168.203.52@tcp:101:dd.0 Request processed in 16068us (16400us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789131447.396126:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1789131447.401615:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131447.402089:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639808 00000100:00100000:0.0:1789131447.402106:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639808 00000100:00100000:0.0:1789131447.402187:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1789131447.402199:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+21:14688:x1876039893639808:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1789131447.402703:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.402728:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.402744:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131447.402813:0:14792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789131447.402847:0:14792:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000547d63c9 reply state 00000000bb04e30f transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131447.402858:0:14792:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131447.402997:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+24:14688:x1876039893639808:12345-192.168.203.52@tcp:36:dd.0 Request processed in 798us (1398us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789131447.403006:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000020:00080000:0.0:1789131447.403031:0:14792:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789131447.408065:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:2.0:1789131447.408600:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408616:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408624:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408652:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f000 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131447.408658:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408667:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408690:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:2.0:1789131447.408694:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131447.408699:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.408705:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905a98 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131447.408996:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893639936 00000100:00100000:0.0:1789131447.409009:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893639936 00000100:00100000:0.0:1789131447.409095:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1789131447.409107:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+23:14688:x1876039893639936:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1789131447.409141:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131447.409163:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905a9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b01 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.409234:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b01 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.409260:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905a9f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b01 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.409283:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131447.409286:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131447.409289:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ea00, rc 0) 00000100:00100000:0.0:1789131447.409409:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+24:14688:x1876039893639936:12345-192.168.203.52@tcp:101:dd.0 Request processed in 305us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131447.409418:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1789131447.424785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131447.425178:0:16913:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640192 00000100:00100000:0.0:1789131447.425190:0:16913:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640192 00000100:00100000:0.0:1789131447.425272:0:16913:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1789131447.425284:0:16913:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f0519b8-1f34-4031-b607-119670debea2+24:14688:x1876039893640192:12345-192.168.203.52@tcp:103:dd.0 00010000:00010000:0.0:1789131447.425304:0:16913:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789131447.425383:0:16913:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905a9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b01 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.426390:0:16913:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131447.426400:0:16913:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789131447.426658:0:16913:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8f0519b8-1f34-4031-b607-119670debea2+23:14688:x1876039893640192:12345-192.168.203.52@tcp:103:dd.0 Request processed in 1371us (1883us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131447.426670:0:16913:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1789131447.431259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131447.431770:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640320 00000100:00100000:2.0:1789131447.431785:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640320 00000100:00100000:2.0:1789131447.431875:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1789131447.431889:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+23:14688:x1876039893640320:12345-192.168.203.52@tcp:58:dd.0 00010000:00010000:2.0:1789131447.432019:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.432040:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131447.432055:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789131447.434847:0:14793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789131447.435056:0:14793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789131447.435153:0:14793:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789131447.435371:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+23:14688:x1876039893640320:12345-192.168.203.52@tcp:58:dd.0 Request processed in 3476us (4118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131447.435387:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:2.0:1789131447.442000:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131447.442943:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640448 00000100:00100000:0.0:1789131447.442961:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640448 00000100:00100000:0.0:1789131447.443068:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1789131447.443082:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+23:14688:x1876039893640448:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1789131447.443111:0:14791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131447.443140:0:14791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b08 expref: -99 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443219:0:14791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443233:0:14791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443257:0:14791:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443272:0:14791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443289:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131447.443311:0:14791:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131447.443316:0:14791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 24 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131447.443375:0:14791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473ea00, rc 0) 00000100:00100000:0.0:1789131447.443684:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+24:14688:x1876039893640448:12345-192.168.203.52@tcp:101:dd.0 Request processed in 603us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131447.443693:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:3.0:1789131447.641732:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789131448.025785:0:14823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789131448.025797:0:14823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131448.025837:0:14823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789131448.025861:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789131448.026021:0:14823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742d8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14823:1876039910404096:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789131448.026231:0:14823:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74d70c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789131448.029245:0:14823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742d8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14823:1876039910404096:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789131448.035803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.035986:0:14802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640576 00000100:00100000:2.0:1789131448.035995:0:14802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640576 00000100:00100000:2.0:1789131448.036060:0:14802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1789131448.036071:0:14802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640576:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789131448.036159:0:14802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640576:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 90us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131448.036167:0:14802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00080000:3.0:1789131448.036886:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789131448.040189:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.040390:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640704 00000100:00100000:0.0:1789131448.040400:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640704 00000100:00100000:0.0:1789131448.040472:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1789131448.040483:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640704:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789131448.040514:0:14792:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789131448.040641:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640704:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 160us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.040648:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1789131448.047049:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.047149:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893640832 00000100:00100000:2.0:1789131448.047159:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893640832 00000100:00100000:2.0:1789131448.047217:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1789131448.047228:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640832:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.047376:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047394:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047407:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047424:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047647:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047665:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047689:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047699:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047706:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131448.047742:0:15748:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789131448.047747:0:15748:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131448.047760:0:15748:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047781:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047788:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047793:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047800:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131448.047803:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047816:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047828:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:2.0:1789131448.047831:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131448.047836:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047842:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905ab4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047853:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047859:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047866:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047871:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131448.047874:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047881:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047888:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c0c5855bb00) 00010000:00010000:2.0:1789131448.047891:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131448.047894:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047909:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905abb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047924:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047929:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047935:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047941:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131448.047944:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047950:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047957:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:2.0:1789131448.047959:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131448.047963:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.047968:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905ac2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.048055:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893640832:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 828us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131448.048072:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1789131448.054772:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.054980:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893641088 00000100:00100000:0.0:1789131448.054990:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893641088 00000100:00100000:0.0:1789131448.055064:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1789131448.055073:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+24:14689:x1876039893641088:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131448.055093:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131448.055123:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905ac9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b0f expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055213:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055227:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055236:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789131448.055247:0:14792:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789131448.055681:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055689:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055696:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055702:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131448.055707:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055715:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055739:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:0.0:1789131448.055742:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789131448.055748:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055754:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ad0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055798:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905ac9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b0f expref: 26 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055809:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c0c5855b300) 00010000:00010000:0.0:1789131448.055812:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789131448.055816:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905ac9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b0f expref: 26 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.055825:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f600, rc 0) 00000100:00100000:0.0:1789131448.055892:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+25:14689:x1876039893641088:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 820us (1129us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789131448.055901:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1789131448.063255:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.063361:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893641216 00000100:00100000:2.0:1789131448.063377:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893641216 00000100:00100000:2.0:1789131448.063433:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1789131448.063452:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+25:14689:x1876039893641216:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789131448.063486:0:15748:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789131448.063623:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56848780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+25:14689:x1876039893641216:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 181us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131448.063631:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1789131448.074758:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.074854:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893641472 00000100:00100000:0.0:1789131448.074864:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893641472 00000100:00100000:0.0:1789131448.074922:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1789131448.074932:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+25:14689:x1876039893641472:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131448.074953:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131448.074974:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905ade lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b16 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789131448.075700:0:14792:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:0.0:1789131448.075708:0:14792:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789131448.075760:0:14792:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:0.0:1789131448.076041:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ae5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.076057:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.076068:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.076127:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905ade lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b16 expref: 28 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.076145:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b16 expref: 27 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.076153:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c700) 00010000:00010000:0.0:1789131448.076156:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789131448.076160:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473e200, rc 0) 00000100:00100000:0.0:1789131448.076230:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42d883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+27:14689:x1876039893641472:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1299us (1481us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789131448.076238:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1789131448.084154:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.084465:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893641728 00000100:00100000:2.0:1789131448.084476:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893641728 00000100:00100000:2.0:1789131448.084538:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1789131448.084559:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0b41d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+27:14689:x1876039893641728:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.084613:0:15748:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131448.084640:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905ae5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b16 expref: 27 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084658:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c700) 00010000:00010000:2.0:1789131448.084684:0:15748:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131448.084707:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084719:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084729:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084744:0:15748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084776:0:15748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084784:0:15748:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084860:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084867:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084873:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084879:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131448.084883:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084969:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084978:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c0c4392c200) 00010000:00010000:2.0:1789131448.084981:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131448.084985:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.084991:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905af3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085001:0:15748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085013:0:15748:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085019:0:15748:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085023:0:15748:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:2.0:1789131448.085026:0:15748:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085032:0:15748:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085040:0:15748:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xeaeff49d (ffff9c0c5855bb00) 00010000:00010000:2.0:1789131448.085043:0:15748:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789131448.085046:0:15748:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.085051:0:15748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905afa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeaeff49d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15748 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.085132:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0b41d86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8f0519b8-1f34-4031-b607-119670debea2+26:14689:x1876039893641728:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 584us (988us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789131448.085140:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1789131448.099745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.099830:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893641856 00000100:00100000:0.0:1789131448.099841:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893641856 00000100:00100000:0.0:1789131448.099907:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1789131448.099917:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+26:14689:x1876039893641856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131448.099952:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131448.099987:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905b01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b1d expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100024:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905b08 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100038:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905b08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100049:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905b08 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100141:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f600/0x9f0de37187905b01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b1d expref: 28 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100160:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f800/0x9f0de37187905b08 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b1d expref: 27 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.100169:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:0.0:1789131448.100172:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789131448.100176:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473f800, rc 0) 00000100:00100000:0.0:1789131448.100239:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+27:14689:x1876039893641856:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 324us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.100246:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1789131448.102944:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.103001:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893642112 00000100:00100000:0.0:1789131448.103011:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893642112 00000100:00100000:0.0:1789131448.103069:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:0.0:1789131448.103079:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+27:14689:x1876039893642112:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789131448.103176:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.103193:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.103206:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789131448.103602:0:14791:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789131448.103613:0:14791:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460077290294ns, next at 461077288009ns, rc = 0 00000004:00010000:0.0:1789131448.103710:0:14791:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009d5d60aa reply state 000000006edb31d1 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.103720:0:14791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789131448.103822:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+29:14689:x1876039893642112:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 742us (885us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789131448.103829:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:3.0:1789131448.109479:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131448.109497:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131448.109505:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.109505:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1789131448.109511:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:3.0:1789131448.109517:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131448.109558:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131448.109577:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:3.0:1789131448.109580:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789131448.109585:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789131448.109591:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473e200/0x9f0de37187905b0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.109656:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893642240 00000100:00100000:0.0:1789131448.109665:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893642240 00000100:00100000:0.0:1789131448.109724:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:0.0:1789131448.109735:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+28:14689:x1876039893642240:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789131448.109758:0:14792:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789131448.109776:0:14792:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b24 expref: -99 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.109833:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 29 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.109860:0:14792:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 29 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.109883:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:0.0:1789131448.109886:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789131448.109900:0:14792:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c7473fc00, rc 0) 00000100:00100000:0.0:1789131448.109956:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+29:14689:x1876039893642240:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 223us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.109963:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1789131448.115674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.117574:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893642368 00000100:00100000:0.0:1789131448.117589:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893642368 00000100:00100000:0.0:1789131448.117737:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1789131448.117751:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+5:2352:x1876039893642368:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789131448.118127:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c56849680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+6:2352:x1876039893642368:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 380us (2461us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789131448.118135:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:1.0:1789131448.118214:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789131448.130712:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.132023:0:14795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893642624 00000100:00100000:0.0:1789131448.132035:0:14795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893642624 00000100:00100000:0.0:1789131448.132104:0:14795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1789131448.132115:0:14795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+29:14689:x1876039893642624:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789131448.133932:0:14795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8f0519b8-1f34-4031-b607-119670debea2+30:14689:x1876039893642624:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 1807us (3218us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789131448.133946:0:14795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1789131448.136872:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.136966:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893642880 00000100:00100000:0.0:1789131448.136976:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893642880 00000100:00100000:0.0:1789131448.137034:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1789131448.137043:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+30:14689:x1876039893642880:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789131448.137167:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+30:14689:x1876039893642880:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 125us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.137174:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1789131448.142650:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.143006:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643008 00000100:00100000:2.0:1789131448.143015:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643008 00000100:00100000:2.0:1789131448.143079:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:2.0:1789131448.143090:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+30:14689:x1876039893643008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.143124:0:14793:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131448.143146:0:14793:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905b1d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b2b expref: -99 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143217:0:14793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143231:0:14793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143242:0:14793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789131448.143277:0:14793:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789131448.143292:0:14793:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143318:0:14793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1200/0x9f0de37187905b1d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b2b expref: 32 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143447:0:14793:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b2b expref: 31 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.143456:0:14793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:2.0:1789131448.143459:0:14793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789131448.143463:0:14793:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1400, rc 0) 00000100:00100000:2.0:1789131448.143522:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+31:14689:x1876039893643008:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 435us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131448.143530:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1789131448.159378:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.159570:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643136 00000100:00100000:2.0:1789131448.159579:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643136 00000100:00100000:2.0:1789131448.159637:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1789131448.159648:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+6:2352:x1876039893643136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.159668:0:15477:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789131448.159689:0:15477:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbbae86fdb039b32 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789131448.159718:0:15477:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3fab8, blocks: 0x1 00010000:00010000:2.0:1789131448.159737:0:15477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1789131448.159742:0:15477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.159751:0:15477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 7 pid: 15477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.159771:0:15477:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 7 pid: 15477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.159785:0:15477:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c0c742b1200, rc 0) 00000100:00100000:2.0:1789131448.159841:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+7:2352:x1876039893643136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 194us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789131448.159848:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1789131448.162930:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.163016:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643392 00000100:00100000:0.0:1789131448.163026:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643392 00000100:00100000:0.0:1789131448.163086:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1789131448.163096:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+31:14689:x1876039893643392:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789131448.163208:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+31:14689:x1876039893643392:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 114us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.163216:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1789131448.167008:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.167113:0:14793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643520 00000100:00100000:2.0:1789131448.167122:0:14793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643520 00000100:00100000:2.0:1789131448.167177:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1789131448.167188:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+31:14689:x1876039893643520:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789131448.205875:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1789131448.205964:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8f0519b8-1f34-4031-b607-119670debea2+30:14689:x1876039893643520:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 38772us (38960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131448.205976:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000004:00080000:3.0:1789131448.206621:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789131448.206673:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1789131448.206692:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789131448.207142:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910404224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789131448.207201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131448.207448:0:17026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910404224 00000100:00100000:2.0:1789131448.207468:0:17026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910404224 00000100:00100000:2.0:1789131448.207526:0:17026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789131448.207536:0:17026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910404224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789131448.207696:0:17026:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789131448.207700:0:17026:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789131448.207703:0:17026:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789131448.207705:0:17026:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789131448 -> 1789131448 00002000:00010000:2.0:1789131448.207708:0:17026:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789131448.207756:0:17026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1876039910404224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 221us (554us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789131448.207763:0:17026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789131448.207828:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1789131448.208001:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c0c55b4cb40/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789131448.208008:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910404224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789131448.212041:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.212147:0:15475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643648 00000100:00100000:0.0:1789131448.212156:0:15475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643648 00000100:00100000:0.0:1789131448.212210:0:15475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1789131448.212220:0:15475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f0519b8-1f34-4031-b607-119670debea2+7:2355:x1876039893643648:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789131448.212535:0:15475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8f0519b8-1f34-4031-b607-119670debea2+7:2355:x1876039893643648:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.212553:0:15475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1789131448.215514:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.215621:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893643904 00000100:00100000:2.0:1789131448.215631:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893643904 00000100:00100000:2.0:1789131448.215691:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1789131448.215700:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+14:14689:x1876039893643904:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.215751:0:14791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789131448.215778:0:14791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b24 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b2b expref: 14 pid: 14793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.215798:0:14791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:2.0:1789131448.215804:0:14791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789131448.215835:0:14791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.215848:0:14791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.215857:0:14791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789131448.216052:0:14791:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e380cfe3 reply state 000000002c7cce79 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.216062:0:14791:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789131448.216161:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8f0519b8-1f34-4031-b607-119670debea2+15:14689:x1876039893643904:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 462us (656us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789131448.216168:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1789131448.219207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.219296:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644032 00000100:00100000:3.0:1789131448.219306:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644032 00000100:00100000:3.0:1789131448.219402:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1789131448.219413:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+7:2354:x1876039893644032:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789131448.219609:0:15478:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789131448.219613:0:15478:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789131447 00002000:00010000:3.0:1789131448.219615:0:15478:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789131447 00002000:00010000:3.0:1789131448.219617:0:15478:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789131448 -> 1789131447 00002000:00010000:3.0:1789131448.219619:0:15478:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789131448.219678:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8f0519b8-1f34-4031-b607-119670debea2+8:2354:x1876039893644032:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 266us (481us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789131448.219703:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00010000:00010000:0.0:1789131448.220278:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.220303:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.220310:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.220316:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b0e00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:0.0:1789131448.222236:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.222256:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.222275:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:0.0:1789131448.222279:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789131448.222284:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.222291:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b0e00/0x9f0de37187905b32 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14791 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789131448.222633:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131448.222819:0:15477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644160 00000100:00100000:1.0:1789131448.222831:0:15477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644160 00000100:00100000:1.0:1789131448.222887:0:15477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1789131448.222897:0:15477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+8:2355:x1876039893644160:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789131448.222940:0:15477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.222955:0:15477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.222960:0:15477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.222967:0:15477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.222980:0:15477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223011:0:15477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223036:0:15477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223043:0:15477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223051:0:15477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb5c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131448.223054:0:15477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223062:0:15477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223074:0:15477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.223081:0:15477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b39 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.223163:0:15477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8f0519b8-1f34-4031-b607-119670debea2+8:2355:x1876039893644160:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 267us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131448.223171:0:15477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1789131448.226433:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.226529:0:14792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644416 00000100:00100000:2.0:1789131448.226539:0:14792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644416 00000100:00100000:2.0:1789131448.226612:0:14792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:2.0:1789131448.226621:0:14792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+14:14689:x1876039893644416:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789131448.226697:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.226714:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.226727:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.226988:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.227000:0:14792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 15 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.227009:0:14792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.227065:0:14792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 15 pid: 14792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.227078:0:14792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 15 pid: 14792 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.227102:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14792:1876039910404352:192.168.203.52@tcp:104: 00000100:00100000:2.0:1789131448.227195:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea780 going to sleep for 11 seconds 00000100:00100000:2.0:1789131448.231249:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14792:1876039910404352:192.168.203.52@tcp:104: 00010000:00010000:2.0:1789131448.231281:0:14792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.233716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131448.233867:0:14776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644544 00000100:00100000:1.0:1789131448.233876:0:14776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644544 00010000:00010000:1.0:1789131448.233919:0:14776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 16 pid: 14792 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.233976:0:14776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1789131448.233986:0:14776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c742dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f0519b8-1f34-4031-b607-119670debea2+16:2352:x1876039893644544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131448.234002:0:14776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131448.234009:0:14776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 16 pid: 14792 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234022:0:14776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 16 pid: 14792 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234043:0:14776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473fc00/0x9f0de37187905b16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b24 expref: 16 pid: 14792 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234058:0:14776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:1.0:1789131448.234063:0:14776:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234073:0:14776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234080:0:14776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.234112:0:14776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131448.234166:0:14776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8f0519b8-1f34-4031-b607-119670debea2+15:2352:x1876039893644544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 181us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131448.234174:0:14776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:2.0:1789131448.237303:0:14792:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.237722:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789131448.237924:0:14792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789131448.238068:0:14792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789131448.238113:0:14792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789131448.238202:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a60fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14792:1876039910404480:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789131448.238268:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131448.238299:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c55c5cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789131448.238960:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910404480 00000100:00100000:1.0:1789131448.238983:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910404480 00000100:00100000:1.0:1789131448.239027:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131448.239037:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14792:x1876039910404480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789131448.239122:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a60de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14792:x1876039910404480:12345-0@lo:1000:mdt00_001.0 Request processed in 86us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131448.239130:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789131448.239172:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a60fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14792:1876039910404480:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789131448.242188:0:14792:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789131448.242282:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14792:1876039910404608:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789131448.242392:0:14792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131448.242425:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c43166a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789131448.243739:0:14796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910404608 00000100:00100000:2.0:1789131448.243752:0:14796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910404608 00000100:00100000:2.0:1789131448.243800:0:14796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789131448.243810:0:14796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c55b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14792:x1876039910404608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789131448.244067:0:14796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c55b4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14792:x1876039910404608:12345-0@lo:1000:mdt00_001.0 Request processed in 257us (1674us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789131448.244075:0:14796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789131448.244805:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14792:1876039910404608:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789131448.244855:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244868:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244876:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244883:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74c65200 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131448.244889:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244897:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244914:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:1.0:1789131448.244929:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131448.244936:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244943:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c74c65200/0x9f0de37187905b47 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244978:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244985:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244992:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.244996:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1a00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131448.245000:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.245005:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.245014:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131448.245016:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789131448.245024:0:14792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.245035:0:14792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.245045:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.245093:0:14792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473ea00/0x9f0de37187905aad lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b08 expref: 18 pid: 14791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.245108:0:14792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14792:1876039910404736:192.168.203.52@tcp:105: 00000100:00100000:1.0:1789131448.245189:0:14792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c509ea780 going to sleep for 11 seconds 00000100:00100000:1.0:1789131448.248617:0:14792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14792:1876039910404736:192.168.203.52@tcp:105: 00010000:00010000:1.0:1789131448.248648:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248659:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1a00/0x9f0de37187905aa6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14793 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248693:0:14792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248708:0:14792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248719:0:14792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248730:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248736:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248743:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248767:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb5c00 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131448.248771:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248778:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248790:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131448.248794:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789131448.248798:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248804:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0b42eb5c00/0x9f0de37187905b4e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248819:0:14792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248826:0:14792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248831:0:14792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248836:0:14792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c742b1400 already unused, calling callback (ffffffffc1f2f4f0) 00010000:00010000:1.0:1789131448.248839:0:14792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248845:0:14792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248863:0:14792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c0c4392c400) 00010000:00010000:1.0:1789131448.248866:0:14792:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789131448.248869:0:14792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.248875:0:14792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c742b1400/0x9f0de37187905b40 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14792 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.249106:0:14792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c742da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8f0519b8-1f34-4031-b607-119670debea2+18:14689:x1876039893644416:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 22483us (22679us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789131448.249118:0:14792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000020:00080000:1.0:1789131448.249124:0:14792:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789131448.249707:0:14823:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789131448.249713:0:14823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789131448.249742:0:14823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789131448.249749:0:14823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789131448.258953:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.259005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.259094:0:14794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644800 00000100:00100000:0.0:1789131448.259104:0:14794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644800 00000100:00100000:0.0:1789131448.259150:0:14794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893644928 00000100:00100000:0.0:1789131448.259165:0:14794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893644928 00000100:00100000:0.0:1789131448.259183:0:14794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:0.0:1789131448.259192:0:14794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5fcd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+19:14689:x1876039893644800:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789131448.259888:0:14794:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789131448.259982:0:14794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789131448.260020:0:14794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260037:0:14794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260048:0:14794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260056:0:14794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260062:0:14794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260068:0:14794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.260086:0:14794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789131448.260187:0:14794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5fcd0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+21:14689:x1876039893644800:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 994us (1242us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789131448.260196:0:14794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000020:00080000:0.0:1789131448.260201:0:14794:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789131448.260247:0:14794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1789131448.260257:0:14794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+20:14688:x1876039893644928:12345-192.168.203.52@tcp:49:dd.0 00000100:00100000:0.0:1789131448.260346:0:14794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8f0519b8-1f34-4031-b607-119670debea2+20:14688:x1876039893644928:12345-192.168.203.52@tcp:49:dd.0 Request processed in 67us (1316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131448.260353:0:14794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00010000:00010000:2.0:1789131448.261562:0:14779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789131448.261573:0:14779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.261582:0:14779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473f000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131448.261586:0:14779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.261596:0:14779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.261612:0:14779:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c0c4392c100) 00010000:00010000:2.0:1789131448.261615:0:14779:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789131448.261621:0:14779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.261627:0:14779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c0c7473f000/0x9f0de37187905b55 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.261643:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131448.261645:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789131448.261646:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789131448.456757:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.456807:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1789131448.456915:0:15482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645056 00000100:00100000:0.0:1789131448.456924:0:15482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645056 00000100:00100000:0.0:1789131448.456985:0:15482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645184 00000100:00100000:0.0:1789131448.456989:0:15482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645184 00000100:00100000:0.0:1789131448.457010:0:15482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1789131448.457021:0:15482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+9:2353:x1876039893645056:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1789131448.457055:0:15482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.457076:0:15482:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 9 pid: 15477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.457086:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.457090:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.457094:0:15482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.457127:0:15482:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 9 pid: 15477 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.457141:0:15482:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 9 pid: 15477 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.457173:0:15482:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c742da1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15482:1876039910404864:192.168.203.52@tcp:104: 00000100:00100000:0.0:1789131448.457264:0:15482:0:(client.c:2715:ptlrpc_set_wait()) set ffff9c0c74d70540 going to sleep for 11 seconds 00000100:00100000:3.0:1789131448.459647:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.459681:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.459706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.459716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.459726:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1789131448.459743:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1789131448.459824:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.459833:0:15483:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1789131448.460282:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645312 00000100:00100000:1.0:1789131448.460291:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645312 00000100:00100000:1.0:1789131448.460364:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.460373:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645440 00000100:00100000:1.0:1789131448.460376:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645440 00000100:00100000:1.0:1789131448.460388:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.460391:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645568 00000100:00100000:1.0:1789131448.460393:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645568 00000100:00100000:1.0:1789131448.460402:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.460408:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645696 00000100:00100000:1.0:1789131448.460409:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645696 00000100:00100000:1.0:1789131448.460419:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.460424:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645824 00000100:00100000:1.0:1789131448.460426:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645824 00000100:00100000:1.0:1789131448.460435:0:15483:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789131448.460440:0:15483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893645952 00000100:00100000:1.0:1789131448.460442:0:15483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893645952 00000100:00100000:3.0:1789131448.462115:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1789131448.462542:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1789131448.462565:0:17028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+15:2353:x1876039893645184:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1789131448.462615:0:17028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.462645:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.462650:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.462655:0:17028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.462665:0:17028:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.463126:0:14777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039893646080 00000100:00100000:1.0:1789131448.463134:0:14777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039893646080 00010000:00010000:1.0:1789131448.463163:0:14777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 16 pid: 15477 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.463202:0:14777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1789131448.463209:0:14777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f0519b8-1f34-4031-b607-119670debea2+16:2353:x1876039893646080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789131448.463220:0:14777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789131448.463239:0:14777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 16 pid: 15477 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463252:0:14777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 16 pid: 15477 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463274:0:14777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.463278:0:14777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.463283:0:14777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463292:0:14777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463301:0:14777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.463303:0:14777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.463306:0:14777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463357:0:14777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.463381:0:14777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789131448.463432:0:14777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8f0519b8-1f34-4031-b607-119670debea2+16:2353:x1876039893646080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 222us (1326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131448.463439:0:14777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:2.0:1789131448.463968:0:17028:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.463980:0:17028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.465869:0:15482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf0cbb6f/0x9f0de37187905b2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xcbbae86fdb039b32 expref: 16 pid: 15477 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.465890:0:15482:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c742da1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:15482:1876039910404864:192.168.203.52@tcp:104: 00010000:00010000:0.0:1789131448.465913:0:15482:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.465923:0:15482:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.465929:0:15482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131448.573765:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:0.0:1789131448.573788:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1789131448.573799:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:2.0:1789131448.573884:0:17028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789131448.573889:0:17028:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789131447 -> 1789131449 00002000:00010000:2.0:1789131448.573892:0:17028:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789131447 -> 1789131449 00002000:00010000:2.0:1789131448.573894:0:17028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1789131448.573907:0:17028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573920:0:17028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573928:0:17028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573953:0:17028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74c64600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131448.573958:0:17028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573968:0:17028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573987:0:17028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.573996:0:17028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088971bc8/0x9f0de37187905b63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.574088:0:17028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+13:2353:x1876039893645184:12345-192.168.203.52@tcp:4:dd.0 Request processed in 111524us (117275us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789131448.574098:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1789131448.574143:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1789131448.574155:0:17028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+12:2352:x1876039893645312:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1789131448.574184:0:17028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.574195:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.574199:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.574206:0:17028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.574228:0:17028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578136:0:15482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578157:0:15482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578166:0:15482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578173:0:15482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e600 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131448.578178:0:15482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578187:0:15482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578206:0:15482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578233:0:15482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe3d0653/0x9f0de37187905b5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.578471:0:15482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+12:2353:x1876039893645056:12345-192.168.203.52@tcp:4:dd.0 Request processed in 121447us (121718us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789131448.578481:0:15482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1789131448.578527:0:15482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1789131448.578538:0:15482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+11:2352:x1876039893645440:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:1.0:1789131448.578580:0:15482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578592:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.578597:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789131448.578602:0:15482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.578614:0:15482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131448.641221:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789131448.641337:0:17028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:2.0:1789131448.641343:0:17028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789131448.641429:0:17028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641444:0:17028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641453:0:17028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641460:0:17028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74c65800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131448.641465:0:17028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641475:0:17028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641494:0:17028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641502:0:17028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.641648:0:17028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+13:2352:x1876039893645312:12345-192.168.203.52@tcp:4:dd.0 Request processed in 67492us (182003us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789131448.641660:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1789131448.641693:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131448.641704:0:17028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+12:2352:x1876039893645568:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1789131448.641734:0:17028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641746:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.641751:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.641756:0:17028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.641769:0:17028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.667668:0:14780:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789131448.683226:0:15482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:0.0:1789131448.683235:0:15482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:0.0:1789131448.683250:0:15482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683280:0:15482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683289:0:15482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683296:0:15482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0b42eb5c00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131448.683301:0:15482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683311:0:15482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683362:0:15482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683553:0:15482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4afebb/0x9f0de37187905b71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.683687:0:15482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+14:2352:x1876039893645440:12345-192.168.203.52@tcp:4:dd.0 Request processed in 105146us (223999us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789131448.683698:0:15482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1789131448.683730:0:15482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131448.683742:0:15482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+13:2352:x1876039893645696:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1789131448.683773:0:15482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683792:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.683797:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.683804:0:15482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.683818:0:15482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789131448.683928:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:1.0:1789131448.722830:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1789131448.725611:0:17028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00002000:00010000:2.0:1789131448.725623:0:17028:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1789131448.725639:0:17028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725652:0:17028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725661:0:17028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725687:0:17028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74c64a00 already unused, calling callback (ffffffffc150e550) 00010000:00010000:2.0:1789131448.725692:0:17028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725701:0:17028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725723:0:17028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725731:0:17028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023d098d3/0x9f0de37187905b78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789131448.725829:0:17028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+11:2352:x1876039893645568:12345-192.168.203.52@tcp:4:dd.0 Request processed in 84124us (266118us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789131448.725840:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1789131448.725877:0:17028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1789131448.725889:0:17028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+10:2352:x1876039893645824:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1789131448.725919:0:17028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725931:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.725935:0:17028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789131448.725941:0:17028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789131448.725965:0:17028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789131448.757408:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1789131448.761153:0:15482:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789131448.761162:0:15482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1789131448.761177:0:15482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761191:0:15482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761200:0:15482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761208:0:15482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e400 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131448.761213:0:15482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761223:0:15482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761267:0:15482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761275:0:15482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000622ddabf/0x9f0de37187905b7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.761433:0:15482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+10:2352:x1876039893645696:12345-192.168.203.52@tcp:4:dd.0 Request processed in 77690us (301710us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789131448.761443:0:15482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1789131448.761480:0:15482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1789131448.761492:0:15482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+9:2352:x1876039893645952:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1789131448.761524:0:15482:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761536:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.761540:0:15482:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789131448.761561:0:15482:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.761572:0:15482:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789131448.789165:0:17028:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:1.0:1789131448.789185:0:17028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789216:0:17028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789226:0:17028:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789233:0:17028:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c74c65800 already unused, calling callback (ffffffffc150e550) 00010000:00010000:1.0:1789131448.789238:0:17028:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789247:0:17028:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789265:0:17028:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789131448.789273:0:17028:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc79214a/0x9f0de37187905b86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 17028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789131448.789503:0:17028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:8f0519b8-1f34-4031-b607-119670debea2+11:2352:x1876039893645824:12345-192.168.203.52@tcp:4:dd.0 Request processed in 63613us (329769us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789131448.789513:0:17028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000001:00080000:1.0:1789131448.789556:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1789131448.827375:0:15482:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789131448.827398:0:15482:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827427:0:15482:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827437:0:15482:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827445:0:15482:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c0c7473e000 already unused, calling callback (ffffffffc150e550) 00010000:00010000:0.0:1789131448.827450:0:15482:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827459:0:15482:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827479:0:15482:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789131448.827487:0:15482:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000872a1778/0x9f0de37187905b8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789131448.827595:0:15482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8f0519b8-1f34-4031-b607-119670debea2+7:2352:x1876039893645952:12345-192.168.203.52@tcp:4:dd.0 Request processed in 66101us (367849us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789131448.827607:0:15482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000001:00080000:1.0:1789131448.827741:0:7662:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789131449.689562:0:16034:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789131450.305989:0:17067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1789131450.331807:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789131450.331833:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910404992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789131450.331915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131450.331964:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910405504:0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.331980:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910405376:0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.332014:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131450.332052:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910405248:0@lo:400:kworker.0 00000100:00100000:3.0:1789131450.332074:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131450.332082:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789131450.332110:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910405760:0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.332131:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131450.332197:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405376 00000100:00100000:1.0:1789131450.332211:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405376 00000100:00100000:1.0:1789131450.332279:0:15478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405248 00000100:00100000:1.0:1789131450.332287:0:15478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405248 00000100:00100000:1.0:1789131450.332316:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131450.332370:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910405376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.332438:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910405376:12345-0@lo:400:kworker.0 Request processed in 71us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131450.332451:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789131450.332469:0:15478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789131450.332475:0:15478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910405248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.332505:0:15478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1876039910405248:12345-0@lo:400:kworker.0 Request processed in 31us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131450.332511:0:15478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789131450.332526:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789131450.332529:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789131450.332747:0:14791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405504 00000100:00100000:2.0:1789131450.332753:0:14791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405504 00000100:00100000:3.0:1789131450.332765:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405760 00000100:00100000:3.0:1789131450.332772:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405760 00000100:00100000:0.0:1789131450.332792:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1876039910405248:0@lo:400:kworker.0 00000100:00100000:2.0:1789131450.332793:0:14791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789131450.332806:0:14791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910405504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.332810:0:14793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789131450.332817:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789131450.332820:0:14793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910405760:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789131450.332826:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131450.332829:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910405120:0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.332860:0:14793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1876039910405760:12345-0@lo:400:kworker.0 Request processed in 42us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131450.332867:0:14793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789131450.332873:0:14791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c7a00f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1876039910405504:12345-0@lo:400:kworker.0 Request processed in 72us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131450.332882:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789131450.332885:0:14791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789131450.332912:0:14784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405120 00000100:00100000:1.0:1789131450.332916:0:14784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405120 00000100:00100000:0.0:1789131450.332924:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910405632:0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.332948:0:14784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789131450.332957:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789131450.332958:0:14784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c42cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3309:x1876039910405120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.332993:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1876039910405760:0@lo:400:kworker.0 00000100:00100000:1.0:1789131450.333000:0:14784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c42cc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80da979a-4558-4a65-9d4f-bd9ca48c3a0e+19:3309:x1876039910405120:12345-0@lo:400:kworker.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789131450.333008:0:14784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789131450.333016:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:80da979a-4558-4a65-9d4f-bd9ca48c3a0e:3309:1876039910405120:0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.333044:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910404992 00000100:00100000:0.0:1789131450.333048:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910404992 00000100:00100000:3.0:1789131450.333070:0:15748:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405632 00000100:00100000:3.0:1789131450.333076:0:15748:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405632 00000100:00100000:0.0:1789131450.333090:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131450.333101:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910404992:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131450.333119:0:15748:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789131450.333129:0:15748:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910405632:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1789131450.333131:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1789131450.333179:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c5684a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910404992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789131450.333186:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789131450.333238:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789131450.333250:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c0c55b4cb40, transno 8589934595 00000100:00100000:3.0:1789131450.333261:0:15748:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1876039910405632:12345-0@lo:400:kworker.0 Request processed in 61us (233us total) trans 0 rc 0/0 00000004:00080000:0.0:1789131450.333262:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1789131450.333273:0:15748:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789131450.333284:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910405376:0@lo:400:kworker.0 00000100:00080000:3.0:1789131450.333295:0:14787:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789131450.333308:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c56849e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910404992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789131450.333432:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c55b4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1876039910405504:0@lo:400:kworker.0 00000100:00100000:0.0:1789131450.333917:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a67cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1876039910405632:0@lo:400:kworker.0 00010000:00010000:2.0:1789131450.714219:0:14779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789131451.354840:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910405888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789131451.354906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789131451.355041:0:15479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876039910405888 00000100:00100000:3.0:1789131451.355049:0:15479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876039910405888 00000100:00100000:3.0:1789131451.355098:0:15479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789131451.355107:0:15479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910405888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789131451.355142:0:15479:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789131451.355198:0:15479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c0c74fbed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1876039910405888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789131451.355206:0:15479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789131451.355283:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9c0c7a00de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1876039910405888:0@lo:13:osp-pre-0-0.0 Debug log: 30003 lines, 30003 kept, 0 dropped, 0 bad.